This study investigated how and how often to present prompts to enhance students' source evaluation and multiple-text comprehension. Participants were 72 undergraduates who read a set of digital texts on a controversial topic of smartphone use and mental health, wrote a justification statement for their selection of trustworthy texts, and answered…

Many educational data mining studies have explored methods for discovering cognitive models and have emphasized improving prediction accuracy. Too few studies have "closed the loop" by applying discovered models toward improving instruction and testing whether proposed improvements achieve higher student outcomes. We claim that such…

In this paper, we present a study of a large corpus of student logic exercises in which we explore the relationship between two distinct measures of difficulty: the proportion of students whose initial attempt at a given natural language to first-order logic translation is incorrect, and the average number of attempts that are required in order to…

Designed to determine whether (1) children of middle socioeconomic status (SES) learn matrix completion rules more rapidly than lower-SES children; (2) feedback influences rate of rule acquisition; (3) rule shifting influences rate of rule acquisition; (4) SES is associated with transfer of training; and (5) effectiveness of rule acquisition and…

A strategy for overcoming problems with the Rasch model's inability to handle missing data involves a pairwise algorithm which manipulates the data matrix to separate out the information needed for the estimation of item difficulty parameters in a test. The method of estimation compares two or three items at a time, separating out the ability…

Tests seven- , 10- , and 13-year-olds for developmental differences in processes and strategies involved in geometric matrix solution and the relationship between strategy differences and item complexity. (AS)

In order to determine the effectiveness of multidimensional scaling (MDS) in recovering the dimensionality of a set of dichotomously-scored items, data were simulated in one, two, and three dimensions for a variety of correlations with the underlying latent trait. Similarity matrices were constructed from these data using three margin-sensitive…

Empirical evidence is presented related to the effects of using a stratified sampling of items in multiple matrix sampling on the accuracy of estimates of the population mean. Data were obtained from a sample of 600 high school students for a 36-item mathematics test and a 40-item vocabulary test, both subtests of the Iowa Tests of Educational…

This paper proposes a methodology to calculate both the difficulty of the basic problems and the difficulty of solving a problem. The method to calculate the difficulty of problem is according to the process of constructing a problem, including Concept Selection, Unknown Designation, and Proposition Construction. Some necessary measures observed…

Although perfectly scalable items rarely occur in practice, Guttman's concept of a scale has proved to be valuable to the development of measurement theory. If the score distribution is uniform and there is an equal number of items at each difficulty level, both the elements and the eigenvalues of the Pearson correlation matrix of dichotomous…

A Monte Carlo study of five indices of dimensionality of binary items used a computer model that allowed sampling of both items and people. Five parameters were systematically varied in a factorial design: (1) number of common factors from one to five; (2) number of items, including 20, 30, 40, and 60; (3) sample sizes of 125 and 500; (4) nearly…

The cognitive structure of an algebra test was defined and validated using the linear test model (LLTM) and quadratic assignment (QA) techniques. The LLTM is an extension of the Rasch model with a linear constraint that describes item difficulty in terms of the cognitive operations required to solve the item. The model permits the specification of…

Matrix tasks designed to assess the logical properties of multiple classification and multiple seriation were administered to 105 first, third, and fifth grade children. The tasks included cross-class and double series matrices, each of which had a reproduction and a transposition instructional set, and a revised set of cross-class and double…

TAILOR is a computer program that uses the implied orders concept as the basis for computerized adaptive testing. The basic characteristics of TAILOR, which does not involve pretesting, are reviewed here and two studies of it are reported. One is a Monte Carlo simulation based on the four-parameter Birnbaum model and the other uses a matrix of…