In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

That teachers should be held accountable for conducting the best possible instructional processes, not for guaranteeing learning, is the view of the National Education Association (NEA). Because of the inadequate nature of tests of student achievement, the diverse nature of student populations, and the various conditions affecting learning, the…

Although emphatically not against the concept of educational accountability, the National Education Association (NEA) feels that a redirection is needed in the implementation of such a system. Because of error, especially in testing minority and poor children, accountability programs should never use test results as the major source of data but…

This paper was presented with other papers in a forum dealing with statewide testing programs. The primary purpose of the paper is to address practical considerations and methods of resolution for large districts or states who are planning on conducting large scale testing or assessment programs with criterion or performance referenced measures.…

A survey, designed to take approximately 15 minutes to complete, was administered to 1,656 elementary school teachers in Michigan to obtain information on a variety of topics related to student assessment and mandated state testing. Most of the teachers were employed in small suburban or urban schools, and 88% were employed in the public schools.…

The effect of calculator type on student performance on a mathematics examination was studied. Differential item functioning (DIF) methodology was applied to examine group differences (calculator use) on item performance while conditioning on the relevant ability. Other survey questions were developed to ask students the extent to which they used…

Some insights into the development of an eleventh grade test of "adult functional competency" are provided. The evolution of the test from its first mention to its translation into a test item pool is traced. An attempt is made to identify some of the instructional, measurement, and legal implications inherent in various decisions which…

Procedures used in securing the cooperation of states and schools for the 1990 Trial State Assessment Program (TSAP) of the National Assessment of Educational Progress (NAEP) are described. These include procedures for: (1) the 1989 Field Test; (2) the training of local administrators and quality control monitors; and (3) scoring and processing…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

A variety of methods are used to assess secondary school seniors in Australia to determine college admission: locally-developed achievement tests in curricular subjects; external achievement tests; and general aptitude tests, such as the Australian Scholastic Aptitude Tests. Testing problems include aggregating and rescaling of scores. (GDC)

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

All states are addressing the problems of accommodations for English Language Learners (ELL's) in state assessment systems, but Massachusetts is noteworthy for the way in which it handles this problem. Since the early 1980s, over 40 states have created a statewide assessment program. Testing in these states is typically modeled on the National…

At the request of the Oklahoma Department of Education, the Technical Assistance Center 3 West conducted a statewide review of local Chapter 1 evaluation data to provide possible explanations for the unusual standardized test score gains or losses reported by a number of local school districts. During the two months of quality control visits, 35…