This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

The design of assessment tools is critical to accurately evaluate students' understanding of chemistry. Although extensive research has been conducted on various aspects of assessment tool design, few studies in chemistry have focused on the impact of the order in which questions are presented to students on the measurement of students'…

Students are an important stakeholder group in the context of quality assurance in higher education. From their perspective as learners, students' views on educational experiences are increasingly used as an indicator of educational quality. The Course Experience Questionnaire (CEQ) is a widely used quantitative tool to gauge students' perceptions…

This study assessed unidimensionality and occurrence of Differential Item Functioning (DIF) in Mathematics and English Language items of Osun State Qualifying Examination. The study made use of secondary data. The results showed that OSQ Mathematics (-0.094 = r = 0.236) and English Language items (-0.095 = r = 0.228) were unidimensional. Also,…

We used the Rule Space Model, a cognitive diagnostic model, to measure the learning progression for thermochemistry for senior high school students. We extracted five attributes and proposed their hierarchical relationships to model the construct of thermochemistry at four levels using a hypothesized learning progression. For this study, we…

In this article, we present several modifications to the Test of Understanding Graphs in Kinematics. The most significant changes are (i) the addition and removal of items to achieve parallelism in the objectives (dimensions) of the test, thus allowing comparisons of students' performance that were not possible with the original version, and (ii)…

K-12 intervention studies often include fidelity of implementation (FOI) as a mediating variable, though most do not report the validity of fidelity measures. This article discusses the critical need for validated FOI scales. To illustrate our point, we describe the development and validation of the Implementation Validity Checklist (IVC-R), an…

The omega (?) statistic is reputed to be one of the best indices for detecting answer copying on multiple choice tests, but its performance relies on the accurate estimation of copier ability, which is challenging because responses from the copiers may have been contaminated. We propose an algorithm that aims to identify and delete the suspected…

This study investigates the psychological effect of a wrong question with wrong items on answering to the next question in a test of structure. Forty students selected through stratified random sampling are given 15 questions of a standardized test namely a TOEFL structure test in which questions number 7 and number 11 are wrong and their answers…

The authors completed a pilot study to examine the original Student Support Needs Scale (SSNS) and alternative forms. They assessed how the items were related to each other, how SSNS versions correlated with each other, and the SSNS versions associations with measures of student attitudes and performance. Eighty students from a historically Black…

Because English is widely used as a lingua franca, language testers have started to consider the introduction of non-native accents into English listening tests. This study investigates how accents influence test-takers' performance, and also elicits test-takers' subjective perception of accents. Eighty adolescent L1-Mandarin test takers were…

Medical programs are under pressure to maintain currency with scientific and technical advances, as well as prepare graduates for clinical work and a wide range of postgraduate careers. The value of the basic sciences in primary medical education was assessed by exploring the perceived clinical relevance and test performance trends among medical…

English-as-a-foreign-language (EFL) textbooks and internet resources exhibit various formats and implementations of exercises on phrasal verbs. The experimental study reported here examines whether some of these might be more effective than others. EFL learners at a university in Japan were randomly assigned to 4 treatment groups. Two groups were…

In Mongolia, teachers' attitudes towards large-scale assessments have been a largely uncovered area. Therefore, this paper focuses on examining the general overview of English language teachers' belief about state-level assessments, and their reflection on teaching practices. Participants of this study were 307 teachers of primary and secondary…

Use of service-learning is burgeoning among higher education institutions in Hong Kong and expanding in Asia. The positive student outcomes that have been reported in Western society, however, are not as widely recognized in Asian society. Asian institutions of higher education need a standardized measurement of outcomes that will help refine the…