To help increase the understanding of sources of difficulty in test items, a study was undertaken to evaluate the effects of various aspects of prose complexity on the difficulty of achievement test items. The items of interest were those that presented a verbal stimulus followed by a question about the stimulus and a standard set of…

This research summarizes differential item functioning (DIF) results for student produced response (SPR) items, a nonmultiple-choice mathematical item type in the Scholastic Aptitude Test I (SAT I). DIF data from 4 field trial pretest administrations (620 SPR items) and 10 final forms (100 SPR items with samples ranging from about 58,000 to over…

A study investigated the effect of a prereading strategy on the reading comprehension of foreign language students. Subjects were 62 French students in 5 classes at 3 suburban high schools. A rotation design was used within each class. A reading in the target language was assigned twice a week for two weeks. The treatment sample went through a…

A total of 149 students enrolled in an undergraduate nursing research methods course participated in a study comparing three strategies for using formative evaluation (test feedback throughout a course) to predict students at risk of failure at summative evaluation (the final examination). Students took 12 weekly multiple-choice quizzes, which…

This digest describes the organization of the National Assessment of Educational Progress (NAEP) and what is included in a typical NAEP assessment. The way in which the NAEP selects students for assessments and how the assessments are used are discussed. The NAEP is a congressionally mandated project of the National Center for Education…

A new method for estimating the parameters of the normal ogive three-parameter model for multiple-choice test items--the normalized direct (NDIR) procedure--is examined. The procedure is compared to a more commonly used estimation procedure, Lord's LOGIST, using computer simulations. The NDIR procedure uses the normalized (mid-percentile)…

The purpose of this study was to determine whether item difficulty is significantly affected by language difficulty and response set convergence. Language difficulty was varied by increasing sentence (stem) length, increasing syntactic complexity, and substituting uncommon words for more familiar terms in the item stem. Item wording ranged from…

This was a replicative study that was initiated with a journeyman level certification instrument for an international union, when industry monitors were observed suggesting to examinees to "go with your first response." The question arose whether this was a researched-based practice. If not, wouldn't this practice inject constant error…

A number of higher order cognitive skills are used in the task of evaluating arguments. Such skills should be assessed because the ability to evaluate arguments is an important one in all subject areas. In addition, it seems reasonable to assume that these evaluative skills will be representative of those required by other cognitively demanding…

The booklet presents the two-part Grade 12 Diploma Examination for the Social Studies 30 program. Part 1 consists of 70 multiple-choice questions worth 70% of the total score. Each question has four choices and students must choose the one which best completes the statement or answers the question. Many questions are based on narratives,…

Three presentations from the Third National Conference on Assessment in Higher Education are included. In "Assessment and Human Values: Confessions of a Reformed Number Cruncher," Alexander W. Astin, focuses on measuring education productivity, assessment lessons from the Cooperative Institutional Research Program, a talent-development…

The evaluation instruments used in the Tennessee Career Ladder program are described, and their evolution over the first three years of program implementation is traced. The instruments are designed to measure teacher performance and to determine outstanding teachers. They include: the Career Ladder Test of Professional Skills (a multiple-choice…

Applied classical measurement theory was used to study the measurement characteristics of Forms A and B of the Finding Embedded Figures Test (FEFT) when the test is administered in a "no-guessing" or "supply" format. Data provided by 69 students at a private university in the southern United States were used. Both forms of the…

This study was designed to gather data on the meaning of imprecise terms from items written by physicians for their students and by test committees for national licensure and certification examinations. A total of 32 members of test committees who write examination items for various medical specialty examinations participated in the study. Each…

The acquisition of the passive sentence structure by 36 adult learners of English as a second language (ESL) was studied. Twelve learners each spoke Arabic, Japanese, and Spanish as their native language. For each language group, four were beginners, four intermediates, and four advanced learners of English. All were studying English at the…