The response process of problem-solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data-driven approach to explore the latent states and state transitions underlying problem-solving process to reflect…

This article explores the ethical use of assessments in leadership training, education, and development. From the importance of having well-trained facilitators to the consideration of power and social identity in the interpretation of individual results, this article advocates for approaching the use of leadership assessments and inventories with…

This study identified and annotated appropriate test items using the multiple-choice test item format in the cognitive domain of the taxonomy of educational objectives in assessing and evaluating musical learning through the descriptive-developmental research design. This assessment approach is one of the key skills needed of Music teachers to…

Objective: To conduct a systematic review of the measures designed to assess sluggish cognitive tempo (SCT) since the first SCT scale using careful test-construction procedures was published in 2009. Methods: The MEDLINE (PubMed), Embase, PsychINFO, and Web of Science databases were searched from September 2009 through December 2019. Articles…

The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Acadience Reading (AR) is a screener for early detection of reading problems in elementary students. Limited research exists, however, on its technical adequacy for evaluation of English Learners (ELs). In this study, we tested the long-term predictive validity and diagnostic accuracies of AR and examined the differences between native…

This study's purpose was to investigate effects of 3 intervention approaches for building working memory (WM) and improving word-problem solving (WPS). Children with mathematics difficulties (n = 240; 7.51 years [SD = 0.33]) were randomized to 4 conditions: a control group, general WM training with contiguous math practice, WPS intervention…

Autism is a prevalent neurodevelopmental condition, highly heterogenous in both genotype and phenotype. This communication adds to existing discussion of the heterogeneity of clinical sequencing tests, "gene panels", marketed for application in autism. We evaluate the clinical utility of available gene panels based on existing genetic…

The aim of this paper is to account for a case study based on the Bergen Translation Corpus (BTC), a project launched to identify specific translation challenges in connection with the National Translator Accreditation Exam (NTAE) in Norway. The corpus is made up of translations by candidates entering the NTAE. The exam is held with no requirement…

Given its centrality to assessment, until the concept of validity includes concern for racial justice, such matters will be seen as residing outside the "real" work of validation, rendering them powerless to count against the apparent scientific merit of the test. As the definition of validity has evolved, however, it holds great…

A diversity of approaches for critically appraising qualitative and quantitative evidence exist and emphasize different aspects. These approaches lack clear processes to facilitate rating the overall quality of the evidence for aggregated findings that combine qualitative and quantitative evidence. We draw on a meta-aggregation of implementation…

In today's world, Principal Preparation Programs (PPPs) need to be innovative in helping principal candidates be more prepared to lead in changing times, but first, they must receive certification successfully. Completing the Praxis exam is the final requirement to gain certification as an instructional leader in Alabama and is often a stressful…