Personalized learning environments requiring the elicitation of a student's knowledge state have inspired researchers to propose distinct models to understand that knowledge state. Recently, the spotlight has shone on comparisons between traditional, interpretable models such as Bayesian Knowledge Tracing (BKT) and complex, opaque neural network…

Approaches to correcting correlation coefficients for range restriction have been developed under the framework of large sample theory. The accuracy of missing data techniques for correcting correlation coefficients for range restriction has thus far only been investigated with relatively large samples. However, researchers and evaluators are…

A growing body of research suggests that accounting for student specific variability in educational data can improve modeling accuracy and may have implications for individualizing instruction. The Additive Factors Model (AFM), a logistic regression model used to fit educational data and discover/refine skill models of learning, contains a…

Purpose: The authors of this study investigated the validity of tense and agreement productivity (TAP) scoring in diverse sentence frames obtained during conversational language sampling as an alternative measure of finiteness for use with young children. Method: Longitudinal language samples were used to model TAP growth from 21 to 30 months of…

Students conducted inquiry using simulations within a rich learning environment for 4 science topics. By applying educational data mining to students' log data, assessment metrics were generated for two key inquiry skills, testing stated hypotheses and designing controlled experiments. Three models were then developed to analyze the transfer of…

Student modeling is a fundamental concept applicable to a variety of intelligent tutoring systems (ITS). However, there is not a lot of practical guidance on how to construct and train such models. This paper compares two approaches for student modeling, Knowledge Tracing (KT) and Performance Factors Analysis (PFA), by evaluating their predictive…

Applied Schmidt-Hunter interactive validity generalization procedure to validity data for cognitive abilities tests for law enforcement occupations. Results indicated apparently lower validities and lesser generalizability for job criteria possibly due to low validity of the criterion and potential role of noncognitive factors. (Author/ABB)

A universal criterion scale is applied to the direct estimation of validity for various groups of law school applicants and to the testing of the assumptions underlying the more familiar extrapolation methods. Data from American law schools are used to illustrate the procedures. (Author/BW)

The predictive analysis approach to adaptive testing originated in the idea of statistical predictive analysis suggested by J. Aitchison and I.R. Dunsmore (1975). The adaptive testing model proposed is based on parameter-free predictive distribution. Aitchison and Dunsmore define statistical prediction analysis as the use of data obtained from an…

The incremental validity of the analytical measure of the revised Graduate Record Examination (GRE) General Test, for predicting first-year graduate grade-point average (GPA), was assessed using data submitted to the GRE Validity Study Service between March 1983 and November 1984. All selected students had data for the three General Test measures…

This paper considers the application of Bayesian techniques for simultaneous estimation to the specification of regression weights for selection tests used in various technical training courses in the Marine Corps. It concludes that a hypothesis of complete generalization of the predictor-criterion relationship would only be retained for selected…

Empirical Bayes methods are shown to provide a practical alternative to standard least squares methods in fitting high dimensional models to sparse data. An example concerning prediction bias in educational testing is presented as an illustration. (Author)

From the fall of 1981 through June 1984, more than 850 disabled examinees took special administration of the Graduate Record Examinations (GRE). Grade point averages were obtained on 278 disabled students; 236 had enough complete data to be included in the study. Disabled students earned lower mean GRE scores than their nonhandicapped counterparts…

Least squares and Bayes methods were used in a cross validation study conducted for comparison purposes. The study applies to situations with the following conditions: predictor data are given on the same scales; criterion data may be given on different scales; and it is necessary to pool data even though criterion scale differences exist. Such a…

Classical multiple regression was compared with Bayesian m-group regression, complete with cross-validation. The setting was a post-developmental studies situation in a comprehensive community college. A secondary purpose of the study was to incorporate an advisor prediction of grade point average (GPA) as input into both regression procedures.…