Purpose: Relying on a design science paradigm, the purpose of this paper is to describe the development and evaluation of items for an ICT artefact that supports the assessment of transversal professional competences within the validation of prior learning (VPL). To do so, the authors build a conceptual bridge between the Occupational Information…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

This study examines the psychometric properties of the Autism Diagnostic Interview-Revised (ADI-R) in the context of DSM-5 in a sample of Chinese children. Using re-mapped ADI-R items and algorithms matched to DSM-5 criteria, and administering to children with autism spectrum disorder (ASD) with and without intellectual disability,…

Some previous studies have shown that increased stress hormone levels have beneficial effects on memory encoding; however, there is no clear consensus on which encoding-related processes are affected by stress hormones. In the present study, we investigated the relationship between interindividual differences in neuroendocrine response to acute…

Test fairness is critical to the validity of group comparisons involving gender, ethnicities, culture, or treatment conditions. Detection of differential item functioning (DIF) is one component of efforts to ensure test fairness. The current study compared four treatments for items that have been identified as showing DIF: deleting, ignoring,…

Objectives: The aim of this study was to develop a scale measuring inclusive school quality from parents' perceptions (Parents' perceptions of Inclusive School Quality, PISQ) and investigate the perceptions of Chinese parents of children with disabilities of inclusive school quality using the PISQ scale. Method: The data for 78 parents of children…

Computational thinking is recognized as a vital skill related to problem-solving in technological and non-technological fields. The existence of different sub-domains related to this skill has been pointed out. Therefore, there is a need for tools that measure these different sub-domains. Because of its structure that includes different skills,…

Despite consistent calls for authentic stimuli in listening tests for better construct representation, unscripted texts have been rarely adopted in high-stakes listening tests due to perceived inefficiency. This study details how a local academic listening test was developed using authentic unscripted audio-visual texts from the local target…

A C-Test is a gap-filling test for measuring language competence in the first and second language. C-Tests are usually analyzed with polytomous Rasch models by considering each passage as a super-item or testlet. This strategy helps overcome the local dependence inherent in C-Test gaps. However, there is little research on the best polytomous…

In recognition memory, anything that is objectively new is necessarily not-old, and anything that is objectively old is necessarily not-new. Therefore, judging whether a test item is new is logically equivalent to judging whether it is old, and conversely. Nevertheless, a series of 10 experiments showed that old? and new? judgments did not produce…

One of the strongest predictors of future academic achievement is the early and informal math skills children begin their school studies. Because of this, it is essential to have proper tools for measuring the development of mathematical thinking at an early age to be able to intervene in a timelier, more effective way. The purpose of this…

The aim of the present study was to examine Turkish teacher candidates' competency levels in writing different types of test items by utilizing Rasch analysis. In addition, the effect of the expertise of the raters scoring the items written by the teacher candidates was examined within the scope of the study. 84 Turkish teacher candidates…

The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item nonequivalent groups design. In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test…

As community-based service-learning becomes more widely used in occupational therapy (OT) education, valid and reliable outcome measures are needed to ensure that student learning outcomes are meaningfully and consistently measured. Currently, educators may use instructor-developed questionnaires that have not been validated or employ narrowly…

In this report, we demonstrate use of differential response time (DRT) methodology, an extension of differential item functioning methodology, for examining differences in how students from different backgrounds engage with assessment tasks. We analyze response time data from a digitally delivered mathematics assessment to examine timing…