International studies like PISA use context student or school questionnaires to collect data on student family background, attitudes and learning context. Questionnaire constructs are typically measured using dichotomous or Likert-type items. Scaling of questionnaire items in order to obtain measures of family background, student attitudes or…

Job analysis has played a fundamental role in developing and validating licensure and certification examinations, but research on what constitutes reliable and valid job analysis data is lacking. This paper examines the reliability and validity of job analysis survey results. Generalizability theory and the multi-facet Rasch item response theory…

Since the Law School Admission Test (LSAT) was first administered, the sponsors of the test have carried out predictive validity studies to evaluate the effectiveness of the test and other predictors in determining first-year law school performance. This report presents a summary of correlation study results for the 1995 and 1996 study years. The…

This study was undertaken to evaluate the predictive validity of the Law School Admission Test (LSAT) earned under accommodated testing conditions. Of special interest was the validity of scores obtained by test takers who were accommodated under nonstandard time conditions (i.e., accommodations that included extra testing time). Separate…

This report compares selected estimates from the two components of the 1995 National Household Education Survey (NHES:95) with estimates from other survey data. The two different components of the NHES:95, the Adult Education (AE) and the Early Childhood Program Participation (ECPP) components, cover a variety of topics related to participation in…

In this technical report, data are presented on the predictive and concurrent relation between various student demographic variables (gender, race/ethnicity, special education status, Title 1 status, English language learning status, and economic disadvantage) and three reading easyCBMs (passage reading fluency, vocabulary, and multiple-choice…

A study was conducted at St. Louis Community College to validate the Nelson-Denny Reading Test (NDRT), Form C, as an instrument for student placement, to empirically establish a cutoff score for a mandatory reading improvement program, and to provide more complete and meaningful feedback to students about their reading test results. The study…

The preliminary report--two-thirds of which consists of tabular data--describes an early identification system used in London, Ontario (Canada) for kindergarten and first grade high risk students, and provides some data bearing on the internal consistency and concurrent validity of the system. Simple descriptive summaries of some characteristics…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

In this study, two statistical approaches for adjusting grades were tested on data obtained from four law schools, with samples of 157, 188, 206, and 191. These approaches were previously validated using data on undergraduates but have not been used in a study of postgraduate performance. Neither method yielded consistent improvements in the…

This paper discusses the measurement of unobservable or latent variables of students and how they contribute to learning in an online environment. It also examines the construct validity of two questionnaires: the College Experience Survey and the Computer Experience Study, which both measure different aspects of student attitudes and behavior…

An integral part of London's early identification process involves an assessment of each pupil's speech and language development. During the 1981-82 school year some initial work was done on the development of a Kindergarten Language Screening Test (KLST). As a result, the KLST was modified and shortened. This paper reports the data derived from…