There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

The application of item response theory (IRT) is almost universal in the development, implementation, and maintenance of large-scale assessments. Therefore, establishing the fit of IRT models to data is essential as the viability of calibration and equating implementations depend on it. In a typical test administration situation, measurement…

Measuring similarity of educational items has several applications in the development of adaptive learning systems, and previous research has already proposed a wide range of similarity measures. In this work, we provide an experimental evaluation of selected similarity measures using a large dataset. The used items are alternate-choice questions…

The iRead EU Project has released literacy games for Spanish, German, Greek, and English for L1 and L2 acquisition. In order to understand the impact of these games on reading skills for L1 German pupils, the authors employed an eye-tracking recording of pupils' readings on a weekly basis as part of an after-school reading club. This work seeks to…

The usage metrics for open educational resources (OER) are often either hidden behind an authentication system or shared intermittently in static, aggregated format at the repository level. This paper discusses the first year of University of Michigan's project to share its OER usage data dynamically, publicly, to synthesize it across different…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

Cooperative and Work-integrated Education (CWIE) programs have been widely accepted as educational programs that can effectively connect what students are learning to the world of work through placements. Because a global quality standards framework could be a very valuable resource and guide to establishing, developing, and accrediting quality…

The vertical scales of large-scale achievement tests created by using item response theory (IRT) models are mostly based on cluster (or correlated) educational data in which students usually are clustered in certain groups or settings (classrooms or schools). While such application directly violated assumption of independent sample of person in…

Five prototypic issues derived from a dialectical perspective are proposed: relationism, evolving reciprocity, probabilism, timing, and the nonequivalent temporal metric. It is argued that these issues, while not changing the scientific method, have implications for specific procedures. (Author)

The multivariate analysis of variance approach to the analysis of data from repeated measures designs that include covariates is reviewed and contrasted with univariate methods. Assumptions necessary for meaningful interpretation of the results of the multivariate analysis are discussed and contrasted to those of the univariate approaches. An…

To counterbalance research emphasis on conventional forms of political participation such as voting, discussing politics, and donating campaign money, the paper presents data from a crossnational study, conducted in 1974, of unconventional as well as conventional participation. "Unconventional participation" is interpreted as including…

The paper develops a theory of political alienation based upon interactions among three antecedent conditions. Political alienation is interpreted as combining feelings of inefficacy, discontent, cynicism, estrangement, and hopelessness. The factors evaluated for their contribution to political alienation are: (1) critical perceptions of…

The problem of sex differences in interest measurement involves many technical issues and procedures. The purpose of this paper is to provide a description of the technical problems involved in construction, scoring, and interpretation of interest measures as related to sex differences and to suggest guidelines within these technical issues which…

The paper discusses an experiment in which regression analysis was used to examine predictors of information retention following a college economics course. It was hypothesized that students taught in small classes with self-instructional materials would place a higher value on basic economic concepts and retain these concepts longer than students…