While there has been considerable research on doctoral examination there is little that examines the various roles of the oral component and what issues one might consider if introducing or revising that aspect of the thesis examination process. This matter is of particular importance in Australia where it is not usual to have an oral component as…

In investigations of unusual testing behavior, a common question is whether a specific pattern of responses occurs unusually often within a group of examinees. In many current tests, modern communication techniques can permit quite large numbers of examinees to share keys, or common response patterns, to the entire test. To address this issue,…

We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between student-level random and fixed effects, and a test for feedback (sometimes called a "falsification test"). We discuss…

While measurement precision is relatively easy to establish for single tests and assessments, it is much more difficult to determine for decision making with multiple tests on different subjects. This latter is the situation in the system of final examinations for secondary education in the Netherlands and is used as an example in this paper. This…

Three procedures that help to determine the degree of confidence we can place in any raw score are discussed: computing the standard error of measurement, computing the estimated true score, and constructing confidence intervals. These three procedures are easy to use and require only elementary mathematical skills. (Author/CL)

The 1969 Invitational Conference on Testing Problems had as its theme "Toward a Theory of Achievement Measurement." Papers presented in Session I, The Nature of Educational Achievement, were: (1) "Concepts of Achievement and Proficiency" by William E. Coffman; (2) "The Functions and Uses of Educational Measurement" by Winton H. Manning; (3)…

Possible bias due to sampling problems or low response rates has been a troubling "nuisance" variable in empirical research since seminal and classical studies were done on these problems at the beginning of this century. Recent research suggests that: (1) earlier views of the alleged bias problem were misleading; (2) under a variety of fairly…

This commentary on the mismeasurement of language and reading comprehension abilities argues that quantitative measures of complex behaviors and subsequent ranking of individual performance often do not accurately reflect the abstract constructs they purport to measure, and inappropriate quantification and ranking create and perpetuate potentially…

Several methods of assessing test item bias are described, and the concept of fair use of tests is examined. A test item is biased if individuals of equal ability have different probabilities of attaining the item correct. The following seven general procedures used to examine test items for bias are summarized and discussed: (1) analysis of…

Practical and effective methods for detecting copying of multiple-choice test responses have been available for many years. These methods have been used routinely by large admissions and licensing testing programs. However, these methods are seldom applied in the areas of standardized or classroom testing in schools or colleges, and knowledge…

Two studies are presented in this report. The first is titled "Empirical Studies of Multilevel Approaches to Test Development and Interpretation: Measuring Between-Group Differences in Instruction." Because of a belief that schooling does affect student achievement, researchers have questioned the empirical and measurement techniques…

A study investigated the effectiveness of the Rasch procedure in measuring response appropriateness, especially for the detection of cheating on multiple-choice language tests. The report gives background information on appropriateness measurement and its potential uses, reviews recent research on cheating and its detection, and describes three…

A discussion of selected applications of new tests developed within the context of a large-scale curriculum for educable mentally retarded (EMR) children, the Social Learning Curriculum (SLC), is presented in this paper which investigates three types of reliability that need to be demonstrated in order to provide a basis of these applications. The…

One of the overriding problems of any psychometric study is that aspects of behavior that are nonquantifiable or difficult to quantify are not considered. The other side of this coin is that those aspects of behavior that are easiest to quantify tend to be what are examined. In evaluating bilingual education programs, problems are found in the…

In eight chapters, this document offers guidelines for school administrators on evaluating schools and school programs, based on a poll of administrators and consultants. The introduction discusses the purpose of evaluation, especially school improvement, and presents a list of evaluation standards. Chapter 1 outlines steps in evaluation planning,…