This article summarizes some of the technical issues that add to the complexity of language testing. It focuses in particular on the criterion-referenced nature of the ACTFL Proficiency Guidelines-Speaking; and it proposes a criterion-referenced interpretation of the ACTFL guidelines for reading and listening. It then demonstrates how using…

To some extent, good testing procedure, like good language use, can be achieved through avoidance of errors. Almost any language-instruction program requires the preparation and administration of tests, and it is only to the extent that certain common testing mistakes have been avoided that such tests can be said to be worthwhile selection,…

Most experts in the testing community have presumed that the $350 million promised by the U.S. Department of Education to support common assessments would promote those that made greater use of open-ended items capable of measuring higher-order critical-thinking skills. But as measurement experts consider the multitude of possibilities for an…

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

The International Test Commission formed a 13-person committee of psychologists representing a number of international organizations to prepare a set of guidelines for adapting educational and psychological tests. The committee has worked for 3 years to produce near final drafts of 22 guidelines organized into 4 categories: (1) context; (2)…

A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

Three pilot studies--effects of writing prompt modality on writing performance; effect of topic familiarity; and effect of topic, sample and rater group membership on the stability of scoring criteria application--are used to identify the variability in student writing performance. A writing competency test aims to assess writing-specific skills…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

Oral tests for speaking skills evaluate two major skills: linguistic competence, including accuracy of pronunciation, vocabulary, and structure, and communication ease. Four factors affect students' oral performance: verbal intelligence, short-term auditory and visual memory, sound-symbol association skill, and grammatical analysis. Personality…

A survey of problems in assessment and examinations in modern languages is offered, focusing in part on lack of consensus among teachers on relative weighting of qualities sought in student answers. Developments in standardized examinations are noted. (MSE)

Marking is described as part of the central examinations for secondary general education in the Netherlands. These consist of two components: an external, and an internal school-based examination. Pedadogical implications of general school assessment practice, plus recent trends, are discussed. (BS)

When the Mesa, Arizona Public Schools initiated an ambitious writing instruction program in 1978, two assessments based on student writing samples were developed. The first is based on a ninth grade proficiency test. If the student does not pass the test, high school remediation is provided. After 1987, students must pass this test in order to…

Procedures used in securing the cooperation of states and schools for the 1990 Trial State Assessment Program (TSAP) of the National Assessment of Educational Progress (NAEP) are described. These include procedures for: (1) the 1989 Field Test; (2) the training of local administrators and quality control monitors; and (3) scoring and processing…

A variety of methods are used to assess secondary school seniors in Australia to determine college admission: locally-developed achievement tests in curricular subjects; external achievement tests; and general aptitude tests, such as the Australian Scholastic Aptitude Tests. Testing problems include aggregating and rescaling of scores. (GDC)

Discussion of how computer technology can be integrated into elementary school instruction focuses on evaluating student learning through test scoring. Highlights include descriptions of a computer-based instructional delivery system, modified confidence weighted admissible probability measurement (MCW-APM), and computer-managed instructional…