The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Vocabulary size measures serve important functions, not only with respect to placing learners at appropriate levels on language courses but also with a view to examining the progress of learners. One of the widely reported formats suitable for these purposes is the Yes/No vocabulary test. The primary aim of this study was to introduce and provide…

Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students' performance on…

Claims abound in the research literature regarding multicultural teacher dispositions, including how to foster them in teacher preparation programs. However, measures of multicultural dispositions of teachers that (a) capture the range of conceptually rich constructs and (b) demonstrate strong psychometric properties are not represented in the…

In this article, I describe the 21 ideas underlying a 42-year search to understand giftedness. I present the ideas roughly chronologically, in the order in which they arose, and discuss how in a career as in science, progress means supplementing or even superseding one idea with the next. In terms of the 21 ideas, I start with a discussion of how…

As the global development community shifts its focus from improving access to education to improving learning and instruction, the need for instruments that accurately measure student achievement in mathematics and meet technical standards is increasing. This paper explores the importance of collecting high-quality validity evidence that aligns…

The Health Belief Model (HBM) is one of the oldest and most recognized conceptual framework of health behavior and can be applied to disaster preparedness efforts which focus predominantly on human behavior. The study aims to develop and test the psychometric properties of the General Disaster Preparedness Belief (GDPB) scale based on the HBM. A…

Bayesian methods incorporate model parameter information prior to data collection. Eliciting information from content experts is an option, but has seen little implementation in Bayesian item response theory (IRT) modeling. This study aims to use ethical reasoning content experts to elicit prior information and incorporate this information into…

Effective teaching of English for Occupational Purposes (EOP) is considered to enhance workers' performance, efficacy, and professional development. Thus, what students and teachers believe to lead to effective EOP teaching is worth exploring. This study set out to compare students' and teachers' beliefs about effective EOP teaching. It employed a…

Purpose: The current study applies an innovative approach to the assessment of second language listening comprehension skills. This is an important focus in need of innovation because scores generated through language assessment tasks should reflect variation in the target skill and the literature broadly suggests that conventional methods of…

Current scholarship on translingual pedagogies focus on writer's translingual strategies and practices. While scholarship explores translingual assessment practices, there is limited quantitative research on how we can measure students' translingual dispositions. This article examines factor structure of a Translingual Disposition Questionnaire to…

This dissertation explored whether unnecessary linguistic complexity (LC) in mathematics and biology assessment items changes the direction and significance of differential item functioning (DIF) between subgroups emergent bilinguals (EBs) and English proficient students (EPs). Due to inconsistencies in measuring LC in items, Study One adapted a…

This study examines the response patterns of 288 Spanish-English dual language learners on a standardized test of receptive Spanish vocabulary. Investigators analyzed responses to 54 items on the "Test de Vocabulario en Imagenes" (TVIP) [Dunn, L. M., D. E. Lugo, E. R. Padilla, and L. M. Dunn. 1986. "Test de Vocabulario en Imganes…

The relationship between second language (L2) listening presage and process variables was examined in a large cross-sectional study. A formal model of learning beliefs was adapted to create a structural equation model testing the interrelationships of individual difference (gender, practice, experience with native teachers) and trait variables…

Foreign language aptitude is defined as one's potential to learn a second language. A language learner with higher aptitude is predicted to learn more, faster, and reach a higher level of proficiency. If this is the case, one way to validate the construct of aptitude and its measure is to conduct a validation study in which measures of aptitude is…