Cognitive diagnosis models (CDMs) have been studied as a means of providing detailed diagnostic information about the skills that have been mastered, and the skills that have not, by examinees. Prior research has examined the use of automated test assembly (ATA) alongside CDMs; however, no previous study has investigated how to perform ATA when a…

This study is a conceptual replication of Ellis' 'Measuring implicit and explicit knowledge of a second language: A psychometric study', published in "Studies in Second Language Acquisition" (2005), aiming to establish the importance of including belief statements (hypothesized to increase processing demands) in the design of Elicited…

It is generally accepted that education is a powerful enabler of social mobility in the modern world. However, access to quality and specialized education is still highly unequal, creating pathways for some groups of people and barriers to others. This dissertation explores three approaches to understanding and addressing inequalities of…

Efficiency in reading component skills is crucial for reading comprehension, as efficient subprocesses do not extensively consume limited cognitive resources, making them available for comprehension processes. Cognitive efficiency is typically measured with speeded tests of relatively easy items. Observed responses and response times indicate the…

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS) to provide guidance to states that are interested in including New Meridian content and would like to either keep reporting scores on the New Meridian Scale or use the New Meridian performance levels; that is, the state…

Grammaticality judgment tests (GJTs) have been, and continue to be, frequently used in the field of SLA as a measure of learners' linguistic ability in the second language (L2). However, only a few studies have examined their construct validity as measures of implicit and explicit knowledge (Bowles, 2011; R. Ellis, 2005), and even fewer have…

College professors often regard their time in the classroom fulfilling and rewarding; the chance to affect the academic and professional development of their students is most likely a key reason why they chose to be professional educators. Unfortunately, with college courses come college credits, which necessitate a course grade for each student,…

This report presents results from a new quantitative synthesis of research on the effectiveness and validity of test accommodations for English language learners (ELLs) taking large-scale assessments. In 2006, the Center on Instruction published a review of the literature on test accommodations for ELLs titled "Practical Guidelines for the…

The implications of various time limits for tests of a fixed length or number of items seem obvious. If the time permitted is much too short, scores may bunch up at the low end of the potential score range, with a loss of potential variance and a general diminishing of the utility of the variance which is observed. If the time permitted is an…

It was found test item arrangement does not significantly influence test results. (CK)

This article describes the use of a Dutch pyramid model that may help teachers design assessment problems that go beyond reproduction and need mathematization, generalization, and insight. (Contains 4 figures.)

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

One of the major steps in the project entitled "A Structure of Concept Attainment Abilities" is to identify reference tests for cognitive abilities. A part of this task involved the construction of some of these types of tests for use with fourth and fifth grade students. This paper presents 35 tests that were constructed or adapted for inclusion…

This paper presents an algorithm for determining the number of items to measure each objective in a criterion-referenced test when testing time is fixed and when the objectives vary in their levels of importance, reliability, and validity. Results of four special applications of the algorithm are presented. (BS)