The array of different philosophical positions underlying contemporary views on competence, assessment strategies and justification have led to advances in assessment science. Challenges may arise when these philosophical positions are not considered in assessment design. These can include (a) a logical incompatibility leading to varied or…

Standard setting is arguably one of the most subjective techniques in test development and psychometrics. The decisions when scores are compared to standards, however, are arguably the most consequential outcomes of testing. Providing licensure to practice in a profession has high stake consequences for the public. Denying graduation or forcing…

A common belief is that the Bookmark method is a cognitively simpler standard-setting method than the modified Angoff method. However, a limited amount of research has investigated panelist's ability to perform well the Bookmark method, and whether some of the challenges panelists face with the Angoff method may also be present in the Bookmark…

Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores and hence to incomplete data on mastery tests such as the AP and U.S. Medical Licensing examinations. Investigators are often interested in estimating the probabilities of passing of the examinees with incomplete data on mastery tests.…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

This paper employs a Critical Cultural Political Economy of Education perspective to examine how, why, and to what effect the English proficiency rankings of a for-profit edu-business acquire the authority often granted to international large-scale assessments. Analysing the EF English Proficiency Index in the context of Ecuador illustrates how…

This qualitative phenomenological study explores the experiences of parents of children with special needs in Turkey, specifically their encounters with Guidance and Research Centers (GRCs) during the process of obtaining educational assessment reports. Through semi-structured interviews with 25 parents, the study reveals complex emotions and…

The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

This study employed a multi-methods design to investigate the impact of preparation on Chinese test-takers' perceptions of the integrated TOEFL iBT speaking and writing design. Combining results from over 1700 surveys and 10 interviews, it was found that these Chinese test-takers, who are the most vulnerable group in the multimillion testing…

This study offers a bibliometric overview of the English language assessment research from 1992 to 2024. It aims to uncover the current state, research trends, and future directions of the field. A total of 927 articles published in Web of Science (WoS) were analyzed using the VOSviewer bibliometric software tool. Based on the sample of 927…

In the past decade, the numeracy component in adult basic education has gained scholarly attention. The issue has been addressed by large-scale assessments of adults' skills and intergovernmental policy agendas, but also by qualitative research into numeracy from the perspective of social practice theory. However, some aspects of numeracy are…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item nonequivalent groups design. In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test…

This brief is organized into four (4) main sections. We first discuss the inadequacy, inefficacy, and bias of standardized, high-stakes assessments. These assessments do not deliver on promises made by proponents and that they, in fact, do long-term harm to teachers and students, with a disproportionate negative impact on communities of color. The…

Research on Portuguese language exams in the language assessment field remains scarce. To bridge this gap, this study examined washback from the large-scale, high-stakes Portuguese proficiency tests created by the Center of Evaluation of Portuguese as a Foreign Language ("Centro de Avaliação de Português Língua Estrangeira," or CAPLE as…