This dissertation aims to investigate the effect size measures of differential item functioning (DIF) detection in the context of cognitive diagnostic models (CDMs). A variety of DIF detection techniques have been developed in the context of CDMs. However, most of the DIF detection procedures focus on the null hypothesis significance test. Few…

Efficiency gains arising from the use of electronic marking tools that allow tutors to select comments from a statement bank are well documented, but how students use this type of feedback remains under explored. Natural science students (N = 161) were emailed feedback reports on a spreadsheet assessment that included an invitation to reply placed…

This study investigated the interaction of disciplinary and interdisciplinary learning in a team-taught, first-year, interdisciplinary sustainability course. We surveyed (pre/post) both STEM (science, technology, engineering, and mathematics) and non-STEM majors (N = 241), assessing attitudes and content knowledge. Responses were analyzed using…

Retrieval practice has been shown to produce significant enhancements in student learning of course information, but the extent to which students make use of retrieval to learn information on their own is unclear. In the current study, students in a large introductory biology course were provided with optional online review questions that could be…

The present study was aimed at investigating the effects of a video feedback coaching intervention for upper-grade primary school teachers on students' cognitive gains in scientific knowledge. This teaching intervention was designed with the use of inquiry-based learning principles for teachers, such as the empirical cycle and the posing of…

Purpose: Studies in the literature have generally demonstrated that the causes of differential item functioning (DIF) are complex and not directly related to defined groups. The purpose of this study is to determine the DIF according to the mixture item response theory (MixIRT) model, based on the latent group approach, as well as the…

Research has shown that hands-on activities in biology/science education tend to improve children's attitudes towards science. These hands-on activities can influence children's interest in various ways, perhaps because they invoke varying emotions. We used a sample of 10-12-year-old children (n = 142) to examine the effect of hands-on activities…

Background: Economists are making increasing use of measures of student achievement obtained through large-scale survey assessments such as NAEP, TIMSS, and PISA. The construction of these measures, employing plausible value (PV) methodology, is quite different from that of the more familiar test scores associated with assessments such as the SAT…

Increasing faculty use of active-learning (AL) pedagogies in college classrooms is a persistent challenge in biology education. A large research-intensive university implemented changes to its biology majors' two-course introductory sequence as outlined by the "Vision and Change in Undergraduate Biology Education" final report. One goal…

Survey participation rates can have a direct impact on the validity of the data collected since nonresponse always holds the risk of bias. Therefore, the International Association for the Evaluation of Educational Achievement (IEA) has set very high standards for minimum survey participation rates. Nonresponse in IEA studies varies between studies…

Understanding sources of performance bias in science assessment provides important insights into whether science curricula and/or assessments are valid representations of student abilities. Research investigating assessment bias due to factors such as instrument structure, participant characteristics, and item types are well documented across a…

Energy is a core concept in the teaching of science. Therefore, it is important to know how students' thinking about energy develops so that elementary, middle, and high school students can be appropriately supported in their understanding of energy. This study tests the validity of a proposed theoretical model of students' growth of understanding…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

We examined how different styles of written feedback by graduate-student teaching assistants (GTAs) in college intro biology lab (USA) influenced student achievement and related the different styles to time efficiency. We quantified GTA feedback on formative lab reports and student achievement on two different types of assessments, a quiz in 2010…

Students' attitude towards science (SAS) is often a subject of investigation in science education research. Survey of rating scale is commonly used in the study of SAS. The present study illustrates how Rasch analysis can be used to provide psychometric information of SAS rating scales. The analyses were conducted on a 20-item SAS scale used in an…