Purpose: The present study aims to evaluate how the reliabilities computed using a, Stratified a, Angoff-Feldt, and Feldt-Raju estimators may differ when sample size (500, 1000, and 2000) and item type ratio of dichotomous to polytomous items (2:1; 1:1, 1:2) included in the scale are varied. Research Methods: In this study, Cronbach's a,…

The American Chemical Society, Division of Chemical Education, Examinations Institute has been developing content maps for the undergraduate program based on subdiscipline specifications since 2008. The Anchoring Concepts Content Maps (or ACCM) have been published in four subdisciplines (general, organic, physical, and inorganic chemistry) with…

Automatic item generation can rapidly generate large volumes of exam items, but this creates challenges for assembly of exams which aim to include syntactically diverse items. First, we demonstrate a diminishing marginal syntactic return for automatic item generation using a saturation detection approach. This analysis can help users of automatic…

Pearson now uses a technology-based testing platform, Q-Interactive, to administer tests previously available in paper versions. The same norms are used for both versions; Pearson's in-house equivalency studies indicated that both versions are equated. The goal of the current study is to independently evaluate equivalency findings. For the current…

This study draws on the understanding that when the correlation between variables is not known yet the non-linear expectation in the correlation between the variables is present, non-linear measurement tools can be used. In education, possibility measurement tools can be used for non-linear measurement. Multiple-choice possibility measurement…

The Rasch model is commonly used to calibrate multiple choice items. However, the sample sizes needed to estimate the Rasch model can be difficult to attain (e.g., consider a small testing company trying to pretest new items). With small sample sizes, auxiliary information besides the item responses may improve estimation of the item parameters.…

The notion of scientific visual literacy has been advocated in recent science curriculum reform documents and related learning outcomes are expected from students. However, few studies have been conducted to determine how it is tested in high-stakes examinations. This study utilized the Visualization Blooming Tool to examine the level of visual…

Vocabulary knowledge strongly predicts second language reading, listening, writing, and speaking. Yet, few tests have been developed to assess vocabulary knowledge in French. The primary aim of this pilot study was to design and initially validate the Context-Aligned Two Thousand Test (CA-TTT), following open research practices. The CA-TTT is a…

Background and Purpose: As a growing number of instructional units have been developed to promote young children's scientific and engineering practices (SEPs), understanding how to evaluate and assess children's SEPs is imperative. However, paper-and-pencil assessments would not be suitable for young children because of their limited reading and…

Assessing students' (mis)conceptions is a challenging task for teachers as well as for researchers. While individual assessment, for example through interviews, can provide deep insights into students' thinking, this is very time-consuming and therefore not feasible for whole classes or even larger settings. For those settings, automatically…

This manuscript aimed to develop an instrument assessing vocational values among students (VVS-S). The scale was developed in French using three different samples of Togolese participants for item development (N = 140), exploratory (N = 308) and confirmatory analyses (N = 300). It consists of 17 items divided into the five subscales of Power,…

Many workforce development training programmes use learning gains as a measure of programme effectiveness. However, research on K-12 education suggests that posttest scores may be influenced by pretesting effects. Pretesting may improve posttest performance by giving learners preknowledge of posttest content. Alternatively, pretesting may enhance…

This article delineates the development of a measure to assess teachers' reported engagement in practices that center on issues of racial equity as part of their SEL instruction. An iterative mixed-method approach included theoretical grounding, literature reviews, content expert evaluation, focus groups, cognitive interviews, and multiple survey…

This study examined integrated science questions of the Basic Education Certificate Examination (BECE) in Ghana at the end of grade 9. Results from BECE determine which senior high school a student can attend. Science questions (n = 751) over the span of eight years were analyzed in this study and viewed under the lens of the revised Bloom's…

Multiple-select multiple-choice items, or multiple-choice items with more than one correct answer, are used to quickly assess content on standardized assessments. Because there are multiple keys to these item types, there are also multiple ways to score student responses to these items. The purpose of this study was to investigate how changing the…