Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

This study aims to develop Taiwan undergraduates' volunteer service motivation scale. To begin with, item pool was proposed on the basis of literature. After discussing with three Taiwan undergraduates, item pool, exploratory factor analysis (EFA) (N = 150) was proceeded, where three tests were conducted EFA: 1. Item analysis: comparisons of…

Are South Africans financially literate, and how can this be measured? Until 2009 there was no South African financial literacy measure and, therefore, the aim was to develop a South African measurement instrument that is scientific, socially acceptable, valid and reliable. To achieve this aim a contextual and conceptual analysis of financial…

The aims of the study were (a) to develop a scale to measure university students' task value and (b) to use confirmatory factor analytic techniques to investigate the construct validity of the scale. The questionnaire items were developed based on theoretical considerations and the final version contained 38 items divided into 4 subscales.…

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to…

Describes a program system which was developed for the purpose of making estimates about the nature of the distribution of test scores which will result from an administration of a test composed of items of which estimates of item-difficulty and discrimination are available. (Author/RC)

This study examines the Average System, an alternate procedure to the Rasch Model, for equating test scores. This technique does not require computers and can be easily employed by classroom teachers. A validation experiment using 23 sets of 10-item arithmetic tests constructed from a 230-item bank is described. (BS)

The desirable characteristics of criterion referenced test items and sets of items are described. A two-stage item tryout and item selection procedure are also described. The paper presents the results of using the procedure as compared with traditional item selection procedures used in selecting items for norm referenced tests. It was found that…

Under the guidance of an advisory committee from the American Association for Respiratory Therapy (AART), The Psychological Corporation developed three forms of two criterion-referenced proficiency examinations to measure the skills, understandings, and knowledge required in entry level jobs for two levels of respiratory therapy personnel. The…

Although actual or projected satisfaction with parenting is important in determining whether a couple will become parents and how large their family will be, only minimal research has assessed parental satisfaction. The Cleminshaw-Guidubaldi Parent Satisfaction Scale, a 50-item Likert-type instrument designed to measure components of satisfaction…

AN INVESTIGATION WAS MADE TO DETERMINE TO WHAT EXTENT TWO METHODS OF ITEM ANALYSIS - NORM REFERENCED AND CRITERION REFERENCED - YIELD THE SAME RELATIVE EVALUATION OF TEST ITEMS. ITEMS WHICH DISCRIMINATED WELL BETWEEN STUDENTS SCORING HIGH AND LOW ON POST-TESTS WERE STUDIED TO SEE IF THEY ALSO DISCRIMINATED WELL BETWEEN PRETRAINING AND…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

Two types of sensitivity indices were developed in this paper, one internal to the total test and the second external. To evaluate the success of these statistics the three criteria suggested for a satisfactory index of item quality were considered. The Internal Sensitivity Index appears to meet these demands. Certainly it is easily computed. In…