Instructional strategies for successfully teaching concepts are found throughout the instructional design literature. These strategies primarily consist of presenting learners with definitions, examples, and non-examples. While examples are important presentation instruments, theorist suggests that examples should not be re-used in the assessment…

Arizona's Instrument to Measure Standards High School (AIMS HS) is an assessment program that measures high school students' achievement of the Arizona Academic Standards adopted by the state Board of Education in three subject areas: reading, writing, and mathematics. All students in high school are required to participate in AIMS HS testing.…

This paper describes and evaluates a new type of multiple-choice test question that is relatively easy to construct and that challenges students' understandings of biological concepts. The questions involve a small narrative of scientific text that students must evaluate for accuracy. These are termed "You are the Teacher" questions because the…

This study examined the relationship between the need for cognition, defined as the tendency to engage in effortful cognitive activity, and metacognition which is one's thinking about thinking and how these variables relate to intellectual task performance. Participants completed measures of need for cognition, metacognition, and problem-solved…

Introduction: Claude Steele's stereotype threat hypothesis proposed that negative group stereotypes increase individual anxiety levels, hurting performance. However, the role of anxiety in stereotype threat has not been fully explored. This study examined the hypothesis that experimental manipulation of stereotype threat would influence real-time…

Student assessment has long been a major component of the tasks that teachers perform. As such, it is important that school leaders consider teachers' assessment strategies as part of the normal supervisory process. In a political climate ruled by the No Child Left Behind Act, one important consideration is how well teachers' assessments prepare…

A lognormal model for the response times of a person on a set of test items is investigated. The model has a parameter structure analogous to the two-parameter logistic response models in item response theory, with a parameter for the speed of each person as well as parameters for the time intensity and discriminating power of each item. It is…

This study examined the multiple true-false (MTF) test format in second language testing by comparing multiple-choice (MCQ) and multiple true-false (MTF) test formats in two language areas of general English: vocabulary and reading. Two counter-balanced experimental designs--one for each language area--were examined in terms of the number of MCQ…

In 2003, a trial National Assessment of Educational Progress (NAEP) mathematics assessment was administered in Spanish to public school students at grades 4 and 8 in Puerto Rico. Based on preliminary analyses of the 2003 data, changes were made in administration and translation procedures for the 2005 NAEP administration in Puerto Rico. This…

The "2004/06 Beginning Postsecondary Students Longitudinal Study (BPS:04/06)" is sponsored by the U.S. Department of Education to respond to the need for a national, comprehensive database concerning issues students may face in enrollment, persistence, progress, and attainment in postsecondary education and in consequent early rates of…

It has been reasonably well established that test takers can sometimes answer correctly some reading comprehension passages without reading the passages on which the questions are based. This issue was studied with the new Scholastic Aptitude Test (SAT) in a study designed to determine the strategies by which examinees are able to achieve…

Recent research in cognitive psychology has drawn attention to the important role that students' personal understandings and representations of subject matter play in the learning process. This paper briefly reviews some of this research and contrasts the kind of learning that results in an individual's changed conception or view of a phenomenon…

Simulated data were used to investigate the performance of modified versions of the Mantel-Haenszel and standardization methods of differential item functioning (DIF) analysis in computer-adaptive tests (CATs). Each "examinee" received 25 items out of a 75-item pool. A three-parameter logistic item response model was assumed, and…

The difficulty of 44 items from the life sciences subscale of the National Assessment of Educational Progress (NAEP) 1985-86 science assessment was analyzed in terms of item attributes and science educators' judgments of difficulty. The attributes included ratings of various characteristics of the items' text and option set, the items' cognitive…

The development and evaluation of methods for detecting potentially biased items or differentially functioning items (DIF) represent a critical area of research for psychometricians because of the negative impact of biased items on test validity. A summary is provided of the authors' 12 years of research at the University of Massachusetts…