Colleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models. We address this lack of transparency by systematically comparing two…

In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

Examines the kind of analysis performed for material on the job prospects in the Occupational Outlook Handbook and evaluates the accuracy of previous projections. Discusses why projections of job outlook are made, methods used in their development, and their accuracy. (JOW)

A metric multidimensional scaling (MDS) procedure based on computer-subject interaction is developed, and an experiment designed to validate the procedure is presented. (Author)

The agreement between visual analysis and the results of the split-middle method of trend estimation was examined using a set of 24 stimulus graphs and 30 raters. Results revealed poor agreement between the two methods, and low sensitivity, specificity, and predictive ability for visual analysis in relation to statistical inferences. (JDD)

The extent of error likely to occur with each of several approximations for the standard deviation, internal consistency reliability, and the standard error of measurement is analyzed. Approximations were compared with exact statistics obtained on 85 different classroom tests constructed and administered by professors in a variety of fields. Means…

Describes the practice of federal evaluation of research impact through three approaches: retrospective methods; qualitative methods, including peer review; and quantitative methods. Recommended areas for study in federal research impact assessment are suggested, including predictive reliability, comparative studies, time and cost estimates,…

THIS REPORT DESCRIBES THE INITIAL VALIDATION OF PERFORMANCE TESTS OF TEACHER EFFECTIVENESS--USING PUPIL GAINS AS THE CRITERION OF EFFECTIVENESS--AND THE STEPS TAKEN IN RECOGNITION OF THE PROPRIETY OF SUCH MEASURES ONLY IF ALL TEACHERS ARE TEACHING FOR THE SAME OBJECTIVES. AS A FIRST STEP, IT WAS HYPOTHESIZED THAT A VALID PERFORMANCE TEST OF…

The major purpose of this study is to further the development of procedures which minimize current limitations of creativity instruments, thus yielding a reliable and functional means for assessing creativity. Computerized content analysis and multiple regression are employed to simulate the creativity ratings of trained judges. The computerized…