Large-scale assessments are supported by a large item pool. An important task in test development is to assign items into scales that measure different characteristics of individuals, and a popular approach is cluster analysis of items. Classical methods in cluster analysis, such as the hierarchical clustering, K-means method, and latent-class…

This study was designed to investigate the adequacy of EFL learners' abilities in three major dimensions of digital literacy skills and whether self-assessments of competence were consistent with their actual performance. It also identified factors that affected learners' use of the selected digital literacy skills. To this end, 60 Saudi EFL…

This article discusses regression effects that are commonly observed in Angoff ratings where panelists tend to think that hard items are easier than they are and easy items are more difficult than they are in comparison to estimated item difficulties. Analyses of data from two credentialing exams illustrate these regression effects and the…

This article examines whether the way that PISA models item outcomes in mathematics affects the validity of its country rankings. As an alternative to PISA methodology a two-parameter model is applied to PISA mathematics item data from Canada and Finland for the year 2012. In the estimation procedure item difficulty and dispersion parameters are…

Assessing job applicants' general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in…

This study conducted a development and validation of a vignette-based grit scale (Grit-V). The purpose was to determine if the use of vignettes provided more validity evidence than short simple-sentence item endorsements. The data were gathered from a sample population of undergraduate students from The University of Alabama. Focus group data were…

According to Dörnyei's model of second language (L2) motivation, the motivated learner aims to incorporate the L2 into his or her self-concept, known as the ideal L2 self. This study examined the internal consistency of Dörnyei's model among ESL Francophone students in Quebec (n = 68) by means of a questionnaire. Correlations were calculated…

Substantial progress has been made toward applying technology enhanced conversation-based assessments (CBAs) to measure the English-language proficiency of English learners (ELs). CBAs are conversation-based systems that use conversations among computer-animated agents and a test taker. We expanded the design and capability of prior…

Effective listening comprehension skills are an important prerequisite for the academic success of primary school students. However, the assessment of listening skills in the instructional language appears to have received only scant attention in the literature. Therefore, the goal of the present study was twofold. Firstly, a comprehensive…

Intercultural competence is a crucial element of foreign language education, yet the multifaceted nature of this construct makes it inherently difficult to assess. Although several tools for evaluating intercultural competence currently exist, research on their use in secondary school settings is scarce. This study reports on the development and…

Representational competence is essential for the acquisition of conceptual understanding in physics. It enables the interpretation of diagrams, graphs, and mathematical equations, and relating these to one another as well as to observations and experimental outcomes. In this study, we present the initial validation of a newly developed…

Collocation is an often-neglected language form that foreign language teachers and students should focus on to achieve competence in a target language. In this research, the researchers studied purposely to facilitate both second language teachers and students to produce correct and appropriate collocations. The purposes of this research were 1)…

States have been restructuring their U.S. history state assessments to include literacy-intensive reading and writing assessment items that have the potential to evaluate students' historical literacy skills in high-stakes testing environments. The purpose of this study was to explore how the restructuring of a U.S. history state assessment with…

A fundamental requirement of language assessments which is underresearched in computerized assessments is impartiality (fairness) or equal treatment of test takers regardless of background. The present study aimed to evaluate fairness in the Pearson Test of English (PTE) Academic Reading test, which is a computerized reading assessment, by…

Social justice research is popular in education, but social scientists have limited emancipatory methodological procedures, especially in scale construction approaches that empower marginalized communities in defining their own lived experience. Therefore, this study develops the Transformativist Measurement Development Methodology, exemplified…