This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

In second language acquisition (SLA) research, two types of second language (L2) knowledge, explicit and implicit, have been discussed for almost three decades. Although many SLA researchers agree that L2 instruction should give priority to implicit knowledge, researchers have not agreed on what type of test (e.g., oral narrative test and timed…

Comparison of scores on the Kaufman Assessment Battery for Children and the Wechsler Intelligence Scale for Children-Revised of 67 students (ages 6-12) referred for possible learning disabilities found strong relationships among all the global standard scores on both instruments with different score patterns for those with severe disabilities.…

This article discusses practical and theoretical problems related to the measurement of formal operations. The first section of the article discusses problems in measuring formal operations using the clinical interview method. These problems include the lack of both a standardized interview and a uniform scoring procedure. Section two discusses…

Techniques derived from item response theory are useful for estimating the reliability of test classification above and below the cutting score. Test developers can construct a test whose information is peaked in the region of the cutting score; users can select a test which provides the most information in this region. The Cut-Score…

The purpose of this study is to examine an option-weighting method as it affects pass-fail decisions in formative and summative evaluation of student achievement for instructional units, certification, advancement, licensure, admissions, placement, and selection. A database was constructed using high school achievement test data where a…

Examines the reliability and validity of the scores of diverse informants from the Child's Report of Parental Behavior Inventory (CRPBI). Also considers the utility of aggregating scores of parental behavior derived from multiple observers. CRPBI items were adapted to obtain mother's, father's, sibling's, and subject's ratings of parental behavior…

This paper describes the Measure of Epistemological Reflection (MER), an instrument to assess cognitive developmental level according to the Perry scheme of intellectual and ethical development. It contains sets of questions for each of the six cognitive domains: decision making, learner role, instructor role in the learning process, peer role in…

A study was undertaken to develop a partial credit scheme for scoring cloze-type questions on an English collocation test, obtain construct validity evidence for the test and the scoring scheme using the Rasch Partial Credit Model, and compare partial credit scoring with the more commonly used dichotomous scoring with the same test instrument.…

The author argues that scoring, reporting, and deriving final grades can be considerably assisted by using a computer. He also contends that the savings in time and the computer database formed will allow instructors to determine test quality and reflect on the quality of instruction. (BW)

The Test of Standard Written English (TSWE) is a 50-item multiple choice instrument designed to assess the ability of college students to use English. In this study, based upon a sample of 45 students, the TSWE was revalidated with writing samples. The coefficient of 0.54 was most impressive given that the TSWE scores were restricted to those…

A method for obtaining curriculum-based estimates of student achievement is described. These estimates can be obtained through the use of a set of curriculum weights designed to reflect student opportunity to learn. If the match between the presented curriculum and test content is low, then the curriculum weights can be used to minimize potential…

The correlation between risk taking behavior and test results on the Torrance Tests of Creative Thinking (TTCT) was examined in a group of 47 fourth and fifth grade students identified for a gifted and talented program. The risk-taking check list (DEEP) was developed by the Downington, Pennsylvania Area School District, and includes four…

This report describes a diagnostic instrument designed for school districts to use in assessing the training needs of bilingual staff. The construction and trial administration of the instrument involved several stages. Among these were the development of a pool of subscaled questions, questionnaire forms, and a pool of instrument questions. The…

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…