This paper describes the process by which a rubric development team affiliated with the National Writing Project negotiated difficulties and dilemmas concerning an analytic scoring category initially termed Voice and later renamed Stance. Although these labels reference an aspect of student writing that many teachers value, the challenge of…

In 2007, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) conducted an assessment of a sample of Year 6 and Year 10 students across Australia to assess their proficiency in civics and citizenship. The assessment of civics and citizenship is part of a national plan that has been put in place to monitor and…

In 2007, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) conducted an assessment of a sample of Year 6 and Year 10 students across Australia to assess their proficiency in civics and citizenship. The assessment of civics and citizenship is part of a national plan that has been put in place to monitor and…

The approaches used by the National Assessment of Educational Progress (NAEP) to characterize syntax, cohesion and mechanics are described. These approaches are different from the Primary Trait System, a scheme used by NAEP for rating essays. Part one of the publication describes the procedures NAEP used to characterize differences in syntactic…

This report summarizes all Year 11 National Assessment of Educational Progress activities performed under Westinghouse DataScore Systems contracts. The general time frame for DataScore's contract activities runs from March 1979 through October 1980 (with the exception of the Year 10 Art Scoring activities which were projected for February 1981…

The process typically employed by testing services in developing professional tests for national use is described: (1) determination of professional standards; (2) development of test specifications; (3) test construction; (4) test registration and administration; and (5) scoring, analysis, and reporting. To determine professional standards, input…

The purpose of this paper is to provide an overview of the analysis of data collected by the National Assessment of Educational Progress (NAEP). In simplest terms, the analysis can be characterized as establishing baseline estimates of the percentages of young Americans possessing certain skills, knowledge, understandings, and attitudes and…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

The third (1978-79) of three writing assessments conducted by the National Assessment of Educational Progress (NAEP) is reported. The writing achievement of American 9-, 13-, and 17-year-olds was surveyed using a deeply stratified, multistage probability sample design. The specific procedures used in the assessment to develop objectives and…

The strengths and weaknesses of the National Assessment of Educational Progress (NAEP) are discussed. The NAEP estimates the number of students who are more likely to do certain problems correctly than other students. NAEP reports the numbers, briefly describes the problems, and says that more students need to do these problems correctly. The…

This proposal suggests the kinds of information that could be developed to inform choices and answer questions related to the national education goals and their specific targets. An important approach to providing this kind of information is being undertaken by the National Assessment Governing Board, which has used panels of judges to set…

In this article some results are presented relating to the dimensionality of instruments containing polytomously scored as well as dichotomously scored items, concentrating on the 1992 National Assessment of Educational Progress' (NAEP) mathematics and reading assessment data and several simulated datasets. The maximum likelihood factor analytic…

The scoring method that will be applied in the current 12th-grade science assessment project of the National Science Foundation and the Office of Educational Research and Assessment is described. The method, "graded mark-point" scoring, is modeled after procedures developed by P. Tamir for use in the performance exercises of the Israeli…

Effects of passage and item-scrambling on equipercentile and item-response theory equating were investigated using 2 scrambled versions of the American College Testing Program Assessment for approximately 25,000 examinees. Results indicate that using a base-form conversion table with a scrambled form affects the individual examinee level. (SLD)

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…