Teacher education in universities continues to diversify in the twenty-first century. Just as course offerings, course delivery, staffing and the teaching/research mix varies extensively from university to university so does the procedure for pre-service teacher selection. Various factors bear on selection procedures and practices however few…

In this article, an instrument for assessing upper secondary school students' levels of technological literacy is presented. The items making up the instrument emerged from a previous study that employed a phenomenographic research approach to explore students' conceptions of technology in terms of their understanding of the "nature…

This article presents a comparative judgment approach for holistically scored constructed response tasks. In this approach, the grader rank orders (rather than rate) the quality of a small set of responses. A prior automated evaluation of responses guides both set formation and scaling of rankings. Sets are formed to have similar prior scores and…

This study was designed to examine select psychometric properties of the Coach Identity Prominence Scale (CIPS), including the reliability, factorial validity, convergent validity, discriminant validity, and predictive validity. Coaches (N = 338) who averaged 37 (SD = 12.27) years of age, had a mean of 13 (SD = 9.90) years of coaching experience,…

We investigated the social validity of the NECC Core Skills Assessment (NECC-CSA) with parents and professionals as participants. The NECC-CSA is a measurement tool consisting of direct and indirect measures of skills important to all individuals with autism, across the lifespan. Participants (N = 245) were provided with a list of 66 skills, 47 of…

Although coach burnout has been studied for 30 years, what measure to use in this context has not yet been problematized. This study focuses on evaluating convergent and discriminant validity of three coach burnout measures by using multi-trait/multi-method analysis (CT-C[M-1]) model. We choose Maslach Burnout Inventory (MBI), the two dimensional…

This paper describes how a short, repeated and structured opportunity to reflect was integrated in the storyline of a serious game in order to stimulate the development of a meta-cognitive skill: the ability to self-assess the degree of confidence in own answers. An empirical validation of the approach, conducted with 28 secondary school pupils,…

This article presents a number of issues on the topic of Language for Specific Purposes (LSP) testing that were raised during a plenary discussion at the 30th annual Language Testing Forum. The comments particularly focused on (a) past and current conceptualizations and categorizations of LSP tests, (b) tensions between specificity and…

In this article, I review and discuss the work presented in this special issue while focusing on a number of issues that warrant further investigation in validation research. These issues pertain to the nature of the validation processes, the processes and mechanisms that support validation during comprehension, the factors that influence…

Possible lack of motivation is a perpetual concern when tests have no stakes attached to performance. Specifically, the validity of test score interpretations may be compromised when examinees are unmotivated to exert their best efforts. Motivation filtering, a procedure that filters out apparently unmotivated examinees, was applied to the…

Content validation is a crucial, but often neglected, component of good test development. In the present study, content validity evidence was collected to determine the degree to which elements (e.g., grammatical structures, items, picture responses, administration, and scoring instructions) of the Comprehension of Written Grammar (CWG) test are…

The concurrent criterion validity of the Ausburg Multidimensional Personality Instrument (AMPI) clinical scales was examined. The AMPI and several scales purportedly measuring the same or similar constructs as those of the AMPI clinical scales were administered to two samples of college students (N = 134 and N = 118). The correlations between the…

The Behavior Rating Inventory of Executive Functions (BRIEF) screens for executive function deficits in 5- to 18-year-olds. Data of three autism subgroups, according to DSM-IV-TR criteria (N = 35 Autistic Disorder, N = 27 Asperger's Disorder and N = 65 PDD-NOS), were analyzed. The total group has elevated scores on almost all BRIEF scales.…

Cloze procedure, a technique not originally intended for measurement purposes, has come to be known as the most widely experimented upon testing tool in English as a Second/Foreign Language (ESL/EFL). Testing experts have indeed used up their energy by constructing and working on various forms of cloze, with the unhappy result that not one person…

Background: The goal of the current study was to determine if the Dementia Rating Scale-2 (DRS-2) is an appropriate tool for evaluating cognitive abilities in adults with Prader-Willi syndrome (PWS). The DRS-2 is a screening measure previously utilised in low-functioning populations with and without dementia, including individuals with…