Experimental designs in the social sciences have received increasing attention due to their power to produce causal inferences. Nevertheless, experimental research faces limitations, including limited external validity and unrealistic treatments. We propose combining qualitative fieldwork and experimental design iteratively--moving back-and-forth…

A quantitative method, meta-analysis, is used to integrate research findings from a representative group of 38 coaching studies. Because different studies reported results on different scales, effect size was used to transform all results to a common metric. This meta-analysis showed that there are two distinct literatures on the effectiveness of…

Addresses the four questions raised by Yelon about use of pretests with instruction--should I pretest; on what should I pretest; how should I pretest; how should I adjust to results--and answers them from the perspective of instructional designers conducting formative evaluations to improve quality of instruction under development. (MBR)

Presented a categorization of types of science education research, their possible contributions to cognitive science, and the potential of results from cognitive science for enriching the science education research accounts. Explored the relationship of an example of cognitive work to cognitive science. (15 references) (Author/JRH)

Described a probe that can assess the learners' understanding of scientific ideas in conditions that do not demand closure on a single interpretation, and where learners can demonstrate certainty or otherwise in several possible alternatives. Can be used in monitoring conceptual change when intuitive understanding of scientific phenomena is to be…

This study focused on two questions: (1) whether the types of study-aid test, or the levels of test anxiety would affect the level of performance on the test under non-anxious conditions; and (2) whether there would be any interaction effect between the types of study-aid test and the levels of anxiety under non-anxious conditions. Twelve female…

Learner Verification and Revision (LVR) has been part of Florida's instructional materials adoption process since 1974, when state statutes required textbook publishers to provide written proof that their materials were revised based on student feedback before publication. Publishers were also required to collect student data and make revisions…

A study evaluated the effectiveness of pretesting infantry soldiers scheduled to take written Skill Qualification Tests (SQT) in order to determine their training needs prior to official testing. During the study, researchers developed and field-tested a pretest for the SQT that was based on the 11B1 Infantryman Soldier's Manual and the 1980 SQT…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

The problem of measuring growth across the target grade and, typically, the two adjacent grades, concerns most developers of standardized, norm-referenced achievement tests, particularly at the item selection stage. Opinion is divided on whether to retain or drop items that do not get easier from grade to grade. The controversy has focused on…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

The Charleston County School District (CCSD) has recently begun development of criterion-referenced tests (CRT) in different subject areas and for different grade levels. This paper outlines the process that CCSD followed in the development of math and language arts tests for grades one through eight and area exams for required high school…