The utility of modified item response theory (IRT) models in small sample testing applications was studied. The modified IRT models were modifications of the one- and two-parameter logistic models. One-, two-, and three-parameter models were also studied. Test data were from 4 years of a national certification examination for persons desiring…

The comprehensive testing program used by the New York City Board of Examiners to develop tests for licensure of teachers is compared with national approaches to licensing. The first step in developing a licensing examination in New York is thorough job analysis leading to the preparation of task statements. These are used to develop lists of…

Curriculum reform in Scotland in the 1970s is described. The implications for testing and teaching are discussed. (GDC)

This content assessment project is designed to determine what social studies content should be tested on national standardized tests and how that content should be defined. Sixteen historians, political scientists, and social studies educators were interviewed to identify key concepts. In a second phase, the cultural literacy rationale for content…

A procedure used to average several Mantel-Haenszel delta difference values for an item is described and evaluated. The differential item functioning (DIF) procedure used by the Educational Testing Service (ETS) is based on the Mantel-Haenszel statistical technique for studying matched groups. It is standard procedure at ETS to analyze test items…

The evolution of the relationship between the College Entrance Examination Board and the Educational Testing Service is outlined, and five aspects of the current cooperative relationship are noted: contractual agreements, shared tasks, specific membership needs, moral obligations to the educational community, and tradition. (MSE)

Issues associated with the lack of statistical skills among educational and psychological researchers are discussed. Issues are associated with accreditation standards, faculty positions for psychometric specialists, measurement curricula, and licensing organizations. The Test User Qualification Working Group has produced a model test user…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

This study was designed to gather data on the meaning of imprecise terms from items written by physicians for their students and by test committees for national licensure and certification examinations. A total of 32 members of test committees who write examination items for various medical specialty examinations participated in the study. Each…

Roles suggested for the National Assessment of Educational Progress (NAEP) in proposed national testing are discussed. Recent proposals center around monitoring, evaluation and accountability, and serving as a benchmark for other tests. Monitoring has been the traditional function of the NAEP, and in this role, its influence has been substantial.…

The 1990 National Assessment of Educational Progress (NAEP) will mark the first time that state-level comparisons will be possible with NAEP data. The 1990 data will contain, as a trial component, state-level assessments of eighth graders in mathematics. Mathematics and reading comparisons for fourth graders will be added in 1992. Statistical…

In this article some results are presented relating to the dimensionality of instruments containing polytomously scored as well as dichotomously scored items, concentrating on the 1992 National Assessment of Educational Progress' (NAEP) mathematics and reading assessment data and several simulated datasets. The maximum likelihood factor analytic…

Lessons learned in changing a large-scale testing program are outlined. The redesigned Scholastic Aptitude Test (SAT) will be administered in spring 1994. Major changes for the verbal SAT section include more emphasis on critical reading, longer and more accessible passages, measurement of vocabulary in context, and use of double passages with two…

How two students with the same number-correct score, calculated by dramatically different patterns of responses, can achieve the same ability estimate is demonstrated. The present study investigated the incidence of person misfit to the model in a nationally standardized test of achievement devised using the Rasch item response theory model. It…

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…