The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Three kinds of classificatory decisions that might be made using criterion-referenced tests (CRTs) are described, and methods to appraise the validity of each are subsequently discussed. Decisions that entail predictive, descriptive, and evaluative classifications comprised the three kinds of decisions described. Predictive classifications entail…

An evaluation was conducted to determine the potential usefulness of the Child Behavior Checklist (CBCL) with 97 children aged 7-17 years living in residential mental health facilities. Comparison with other measures of behavioral functioning suggests the utility of the CBCL for evaluating children in residential placement settings. (SLD)

Although the primary use of the speaking section of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT Speaking test) is to inform admissions decisions at English medium universities, it may also be useful as an initial screening measure for international teaching assistants (ITAs). This study provides criterion-related…

As high-stakes use of tests increases, it becomes vital that test developers and test users communicate clearly about the accuracy and limitations of the scores generated by a test after it is assembled and used. A procedure is described for portraying the accuracy of test scores. It can be used in setting accuracy targets during form construction…

The validity of using proficiency test scores to make specific educational decisions is addressed. Ninth grade mathematics proficiency test scores were analyzed in both continuous and categorized form. The nature of the decisions to be made was examined as a factor in determining the categorization technique. (Author/PN)

The IDEA Oral Language Proficiency Test (IPT II), an individually-administered measure of speaking and listening proficiency in English as a Second Language designed for secondary school students, is described and discussed. The test consists of 91 items and requires 5-25 minutes to administer. Raw scores are converted to one of seven proficiency…

The relationship between scores on the cognitive domain of the Battelle Developmental Inventory (BDI) and scores on the Stanford-Binet Intelligence Test (SBIT), Fourth Edition, was studied for 32 urban, low socioeconomic status (SES), African American children (22 males and 10 females) aged 3 to 5 years. The BDI is a developmental inventory…

The Singer-Loomis Inventory of Personality (SLIP) was developed by two Jungian analysts to allow examination of personality from the perspective of Jung's typology and to solve problems perceived with the Myers-Briggs Type Indicator, based on Jungian dichotomies. The SLIP is designed to clarify and describe the user's personality based on the…