Background: We adopted a theoretical framework that the acquisition of a scientific concept comprises the development of connections among conceptual elements associated with a scientific term within a mental semantic network. Given this framework, the hypothesis that the surrounding words connected with a scientific term are relevant to the…

This study examined indicators of cheating on a statewide summative assessment for grades 3--8 over a 4-year period. Between year 2 and year 3 of this study, the state launched an aggressive, highly publicized investigation into cheating by educators. The basis of the investigation was an erasure analysis. The current study found that the number…

The purpose of this study is to evaluate two methodological perspectives of test fairness using a national Secondary School Certificate (SSC) examinations. SSC is a suit of multi-subject national qualification tests at Grade 10 level in South Asian countries, such as Bangladesh, India, and Pakistan. Because it is a high-stakes test, the fairness…

The study investigated the impact of item position in multiple-choice test on student performance at the Basic Education Certificate Examination (BECE) level in Ghana. The sample consisted of 810 Junior Secondary School (JSS) Form 3 students selected from 12 different schools. A quasi-experimental design was used. The instrument for the project…

Detecting unusual similarity in the item responses of a pair of examinees usually conditions on the pair's overall test performance (e.g., raw scores). Doing this, however, often requires assumptions about the invariance of other examinee pair characteristics. In this study, we examined the appropriateness of such assumptions about selected…

This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple-choice (MC) item anchor in mixed-format tests, which include both MC and constructed-response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC-only anchor set for 4…

Mixed-format tests containing both multiple-choice and constructed-response items are widely used on educational tests. Such tests combine the broad content coverage and efficient scoring of multiple-choice items with the assessment of higher-order thinking skills thought to be provided by constructed-response items. However, the combination of…

This study focused on examining the effect of two alternative school types on student success in Mississippi. To determine alternative school type, alternative program directors self-reported program design, and schools were divided into two groups. Type I schools were defined as "punitive-based" programs in which students receive…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.