Interest in applied performance testing and concern about the quality of the high school diploma are finding a common ground: graduation requirements. A competency is a complex capability applicable in real life situations, and can be used as program objectives in a competency-based, criterion-referenced program. In such a program, applied…

Mastery tests are analyzed in terms of the number of skills to be mastered and the number of items per skill, in order that correct decisions of mastery or nonmastery will be made to a desired degree of probability. It is assumed that a random sample of skills will be selected for measurement, that each skill will be measured by the same number of…

The optimal test length, using predictive validity as a criterion, depends on two major conditions: the appropriate item-difficulty rather than the total number of items, and the method used in scoring the test. These conclusions were reached when responses to a 100-item multi-level test of reading comprehension from 136 non-native speakers of…

The Nebraska Assessment Battery of Essential Learning Skills (N-ABELS) is a goal-oriented instrument with an evaluation component providing a basis for determining acquisition of twelve skills defined as learning goals. Each goal is stated in terms of an acceptable performance standard which clearly describes what the student must do. The skills…

The first four chapters of this report primarily provide an extensive, critical review of the literature with regard to selected aspects of the criterion-referenced and mastery testing fields. Major topics treated include: (a) definitions, distinctions, and background, (b) the relevance of classical test theory, (c) validity and procedures for…

This report examines how selection fairness is influenced by the item characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, and degree of item bias. Computer simulation was used in the administration of conventional ability tests to a hypothetical target population consisting of…

Discusses some of the aspects of problem solving that teachers can observe for assessment purposes in a student's practical and written work. Suggests that these observations can be incorporated into a student's assessment traditionally or using alternative assessment devices. (PK)

Discusses some difficulties that medical students experience in taking exams containing multiple choice questions. Differentiates between multiple true/false type questions, in which several answers may be true, and one-out-of-four type, in which only one answer is correct. Provides tips for taking and making multiple choice tests. (TW)

Describes design of an item bank for use with lower ability mathematics students in Scottish secondary schools. Aspects of bank usage discussed include raw score translation to measures on validated scales, test design for various purposes, and ways of recording and analyzing results. Test examples with corresponding outputs are given. (Author/MBR)

A study investigated cultural bias in the McCarthy Scales of Children's Abilities, using 50 Anglo and 50 Mexican American University of Arizona education graduate students to rate all 46 verbal items. Results showed significant differences in the group ratings of 16 items on the opportunity-to-learn dimension. (MH)

There are few certifying or recertifying examinations in the medical field that are given in a take-home format. This stems from a concern that examinees may discuss items with peers, or save copies of items on the exam and then pass them on to others. This study examined if item exposure on take-home examinations influences the difficulty of the…

This sampler of student responses to mathematics and science items was assembled to show how student responses differ depending on whether students are tested in English or in their native languages. The sampler aims to promote awareness among teachers and assessment developers that low language proficiency in English is a factor that can penalize…

This paper presents a comparative analysis of the Western Australian Calculus Tertiary Entrance Examination (TEE) papers for 1996-99, two years before and two years after the introduction of graphics calculators on the examination. Changes in the questions that asked students to graph rational functions and students' answers to the corresponding…

This study examined the impact of students' background characteristics (English language proficiency) on the level of effectiveness of various types of testing accommodations. Data were collected from 946 eighth graders, some of whom were English language learners. Four accommodation strategies were used: (1) modified (simplified) English language…

This paper seeks to extend the application of Markov chain Monte Carlo (MCMC) methods in item response theory (IRT) to include the estimation of equating relationships along with the estimation of test item parameters. A method is proposed that incorporates estimation of the equating relationship in the item calibration phase. Item parameters from…