This article presents key features of the mathematics assessment in OECD's Programme for International Student Assessment (PISA), from the point of view of the design of test items to fit in with the PISA mathematics framework. A brief description is first given to provide some background to the development of the PISA mathematics framework. The…

The authors investigated in this study the effects of two electronic notes conditions (complete vs. partial) and two testing conditions (immediate vs. delayed) on three types of tests (fact, structure, and application). A 2 x 2 factorial multivariate analysis of variance (MANOVA) yielded no significant main effects for notes conditions on the fact…

Student assessment has long been a major component of the tasks that teachers perform. As such, it is important that school leaders consider teachers' assessment strategies as part of the normal supervisory process. In a political climate ruled by the No Child Left Behind Act, one important consideration is how well teachers' assessments prepare…

A lognormal model for the response times of a person on a set of test items is investigated. The model has a parameter structure analogous to the two-parameter logistic response models in item response theory, with a parameter for the speed of each person as well as parameters for the time intensity and discriminating power of each item. It is…

This study examined the multiple true-false (MTF) test format in second language testing by comparing multiple-choice (MCQ) and multiple true-false (MTF) test formats in two language areas of general English: vocabulary and reading. Two counter-balanced experimental designs--one for each language area--were examined in terms of the number of MCQ…

In 2003, a trial National Assessment of Educational Progress (NAEP) mathematics assessment was administered in Spanish to public school students at grades 4 and 8 in Puerto Rico. Based on preliminary analyses of the 2003 data, changes were made in administration and translation procedures for the 2005 NAEP administration in Puerto Rico. This…

The "2004/06 Beginning Postsecondary Students Longitudinal Study (BPS:04/06)" is sponsored by the U.S. Department of Education to respond to the need for a national, comprehensive database concerning issues students may face in enrollment, persistence, progress, and attainment in postsecondary education and in consequent early rates of…

In this technical report, the authors describe the development and piloting of reading comprehension measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fifth grade. They begin with a brief overview of the two conceptual frameworks underlying the…

In an effort to overcome deficiencies in teaching molecular biology at school, a workshop in an out-of-school laboratory including only authentic experiments was developed. Evaluation of 337 A-level 12th graders followed a quasi-experimental design, with one hands-on group, two non-experimental control groups (at school/in the laboratory), and one…

Formulating-Hypotheses (F-H) items present a situation and ask the examinee to generate as many explanations for it as possible. This study examined the generalizability, validity, and examinee perceptions of a computer-delivered version of the task. Eight F-H questions were administered to 192 graduate students. Half of the items restricted…

The purpose of this study was to gauge the disadvantage, if any, of reaching difficult items that appear earlier in a test, at the expense of not reaching easier items that appear later in a test. The study focused on Scholastic Aptitude Test (SAT) and Graduate Management Admissions Test (GMAT) data and examined the effect for females, Asian…

Three new computer-administered item types for the analytical scale of the Graduate Record Examination (GRE) General Test were developed and evaluated. One item type was a free-response version of the current analytical reasoning item type. The second item type was a somewhat constrained free-response version of the pattern identification (or…

The purpose of the Graduate Record Examinations (GRE) figural-response project was to design a prototype computer assessment system for delivering and scoring figural-response items in the domain of cell and molecular biology and to begin to investigate properties of the item format. This report describes progress to date in an effort that is…

Time limits on tests often prevent some examinees from finishing all of the items on the test; the extent of this effect has been called the "speededness" of the test. Traditional speededness indices focus on the number of unreached items. Other examinees in the same situation rapidly fill in answers in the hope of getting some of the…

The construction of parallel editions of conventional tests for purposes of test security while maintaining score comparability has always been a recognized and difficult problem in psychometrics and test construction. The introduction of new modes of test construction, e.g., adaptive testing, changes the nature of the problem, but does not make…