This paper illustrates the application of existing guidelines to develop a test grounded in theoretical perspectives and empirical findings in the area of problem solving. By documenting this process, the paper outlines the challenges test developers face when seeking to construct a theory/research-driven test, discusses the decisions made at…

Paul E. Newton's article is valuable in many ways, especially for clarifying confusions and inconsistencies in the assessment business. Most importantly, he points out confusions that persist and where open discussion will help us understand what we say and what we mean to say. But I will focus here on the only faults I find in the article: three…

Paul E. Newton provides an insightful and scholarly overview of central issues in validity theory. As he notes, many of the conceptual problems in validity theory derive from the fact that the word "validity" has two meanings. First, it indicates "whether a test measures what it purports to measure." This is a factual claim about the psychometric…

Paul E. Newton is to be commended for addressing as challenging a topic as the clarification of the concept of validity. The impetus for this foray is Newton's judgment that, despite decades of development, the definition and elaboration of the term test validity in the 1999 "Standards" retains sufficient ambiguity to permit, if not invite, both…

Lee Cronbach once expressed the view that all roads lead to construct validity. In looking to clarify the consensus definition of validity, and its place in assessment, Newton is also led to the troublesome idea of construct validity. To be sure, he addresses other validity issues, but in this commentary, I will restrict my attention to construct…

Evaluative conditioning (EC) is the valence change of a (typically neutral) stimulus (CS) that is due to the previous pairing with another (typically valent) stimulus (US). It has been repeatedly shown that EC effects are stronger or existent only if participants know which US was paired with which CS. Knowledge of the CS-US pairings is usually…

Language testing has seen unprecedented expansion during the first part of the 21st century. As a result there is an increasing need for the language testing profession to consider more precisely what it means by "assessment literacy" and to articulate its role in the creation of new pedagogic materials and programs in language testing…

In this study, a ranking strategy was evaluated for comparing subgroups' change using identical, equated, and nonidentical measures. Four empirical data sets were evaluated, each of which contained examinees' scores on two occasions, where the two occasions' scores were obtained on a single identical measure, on two equated tests, and on two…

This paper focuses on the factors that are likely to play a role in individual learning outcomes from group discussions, and it includes a comparison featuring test-enhanced learning. A between-groups design (N = 98) was used to examine the learning effects of feedback if provided to discussion groups, and to examine whether group discussions…

The term scientific literacy is increasingly used by governments and teaching bodies, stemming from a growing international concern by scientists and government, who recognize the economic significance of developing scientific skills (McGregor & Kearton, 2010). However, in a society that requires students to be scientifically literate,…

In the spring of 2015, many states began administering new state assessments designed to measure students' mastery of the Common Core State Standards (CCSS) in mathematics and English language arts (ELA). This was the first wide-scale assessment of student mastery of the Common Core. For some states, it was also the first time that state math and…

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

For a testing program with frequent administrations, it is important to understand and monitor the stability and fluctuation of test performance across administrations. Different methods have been proposed for this purpose. This study explored the potential of using multilevel analysis to understand and monitor examinees' test performance across…

This paper describes the effect that assistive technologies, such as paper, printing, protractors, logarithm tables, computers, and the Internet, have on pedagogy. It reports the results of experiments with self-organising systems in primary education and develops the concept of a self-organised learning environment (SOLE). It then describes how…

Current large-scale assessment and accountability policies in the United States emphasize the need for all students to be appropriately included. However, there are many challenges to effective inclusion. Students with autism spectrum disorder (ASD) exhibit unique social communication and behavior challenges that can hinder their effective…