Large-scale assessment programs such as the National Assessment of Educational Progress (NAEP), Trends in International Mathematics and Science Study (TIMSS), and Programme for International Student Assessment (PISA) use a sophisticated assessment administration design called matrix sampling that minimizes the testing burden on individual…

Studying how children learn words in a foreign language can shed light on how language learning changes with development. In one experiment, we examined whether three-, four-, and five-year-olds could learn and remember words for familiar and unfamiliar objects in their native English and a foreign language. All age groups could learn and remember…

Problem Statement: One of the most frequently neglected aspects of testing is teachers' attitudes. Overall, in-service teachers may have a preconception of what testing means and what its implications are both in high and low stakes testing. However, very few studies have addressed the realities or opinions of pre-service teachers. Methods: Two…

Effective software testing identifies potential bugs and helps correct them, producing more reliable and maintainable software. As software development processes have evolved, incremental testing techniques have grown in popularity, particularly with introduction of test-driven development (TDD). However, many programmers struggle to adopt TDD's…

This booklet grew out of a half-day class on equating that author Samuel Livingston teaches for new statistical staff at Educational Testing Service (ETS). The class is a nonmathematical introduction to the topic, emphasizing conceptual understanding and practical applications. The class consists of illustrated lectures, interspersed with…

Poor motivation is commonly cited as a concern when interpreting results from low-stakes standardized tests administered to postsecondary students. This study investigates the associations between test administration procedures and students' self-reported effort and performance on the Collegiate Learning Assessment (CLA), an open-ended test of…

It is almost self-evident that test results will be unreliable and misleading if those undergoing assessments do not make a full effort on testing. Nevertheless, objective tests of effort have not typically been used with young adults to determine whether test results are valid or not. Because of the potential economic and/or recreational benefits…

Although the memorial benefits of testing are well established empirically, the mechanisms underlying this benefit are not well understood. The authors evaluated the mediator shift hypothesis, which states that test-restudy practice is beneficial for memory because retrieval failures during practice allow individuals to evaluate the effectiveness…

In this study, potential benefits of early memory testing were examined in terms of "inoculating" eyewitness memory against forgetting. As predicted by fuzzy trace theory (e.g., Reyna & Titcomb, 1997), a larger testing advantage in the delayed recall of event details was expected after immediate testing than after delayed testing…

Paul E. Newton's article on the consensus definition of validity tackles a number of big issues and makes a number of strong claims. I agreed with much of what he said, and I disagreed with a number of his claims, but I found his article to be consistently interesting and thought provoking (whether I agreed or not). I will focus on three general…

The representation of item and associative information in episodic memory was investigated using cued recall and single item recognition. In the first four experiments, participants studied two lists constructed such that some items presented in a pair during List 1 were rearranged to create new pairs in List 2 and were accompanied by pairs…

Extreme linkings are performed in settings in which neither equivalent groups nor anchor material is available to link scores on two assessments. Examples of extreme linkages include links between scores on tests administered in different languages or between scores on tests administered across disability groups. The strength of interpretation…

This paper describes the process for creating and validating an assessment test that measures the effectiveness of instruction by probing how well that instruction causes students in a class to think like experts about specific areas of science. The design principles and process are laid out and it is shown how these align with professional…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

The desirability of test equating to maintain the same criterion standard from test administration to test administration has long been accepted for multiple choice tests. The same consistency of expectations is desirable for performance tests, especially if they are part of a licensure or certification process or used for other high stakes…