It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

The Next Generation Science Standards (NGSS) delineate three interrelated dimensions that describe what students should know and how they should engage in science learning. These present significant challenges for assessment because traditional assessments may not be able to capture the ways in which students engage with content. Science…

The Big Data for Education Spoke of the NSF Northeast Big Data Innovation Hub and ETS co-sponsored an educational data mining competition in which contestants were asked to predict efficient time use on the NAEP 8th grade mathematics computer-based assessment, based on the log file of a student's actions on a prior portion of the assessment. In…

Automatic machine learning (AutoML) methods automate the time-consuming, feature-engineering process so that researchers produce accurate student models more quickly and easily. In this paper, we compare two AutoML feature engineering methods in the context of the National Assessment of Educational Progress (NAEP) data mining competition. The…

The increasing amount of available subjective text data in internet such as product reviews, movie critiques and social media comments provides golden opportunities for information retrieval researchers to extract useful information out of such datasets. Topic modeling and sentiment analysis are two widely researched fields that separately try to…

The multidimensional item response theory (MIRT) models with covariates proposed by Haberman and implemented in the "mirt" program provide a flexible way to analyze data based on item response theory. In this report, we discuss applications of the MIRT models with covariates to longitudinal test data to measure skill differences at the…

Students' mental models of diffusion in a gas phase solution were studied through the use of the Structure and Motion of Matter (SAMM) survey. This survey permits identification of categories of ways students think about the structure of the gaseous solute and solvent, the origin of motion of gas particles, and trajectories of solute particles in…

When validating assessment models built with data mining, generalization is typically tested at the student-level, where models are tested on new students. This approach, though, may fail to find cases where model performance suffers if other aspects of those cases relevant to prediction are not well represented. We explore this here by testing if…

This study identified classes of developmental trajectories of physical dating violence victimization from grades 8 to 12 and examined theoretically-based risk factors that distinguished among trajectory classes. Data were from a multi-wave longitudinal study spanning 8th through 12th grade (n = 2,566; 51.9 % female). Growth mixture models were…

This paper illustrates how information collected through interviews can develop a richer understanding of the assignment mechanism, which can result in more plausible causal effect estimates from observational studies and provides a roadmap for sensitivity analysis. Focusing on the issue of assignment to algebra in 8th grade, the author shows how…

Self-report data from 2,088 sixth-grade students in 11 middle schools in North Carolina were combined with administrative data on their eighth-grade end-of-the-year achievement scores in math and reading to examine the influence of students' perceived parental school behavior expectations on their academic performance. Through use of multilevel…

In this study, we analyse the predictive power of home and school environment-related factors for determining pupils' aggression. The multiple regression analyses are performed for fourth- and eighth-grade pupils based on the Trends in Mathematics and Science Study (TIMSS) 2007 (N = 8394) and TIMSS 2011 (N = 9415) databases for Slovenia. At the…

Mathematics is rich in visual representations. Such visual representations are the means by which mathematical patterns "are recorded and analyzed." With respect to "vocabulary" and "symbols," numerous educators have focused on issues inherent in the language of mathematics that influence students' success with mathematics communication.…

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

In the current study, based on a sample of 1,873 adolescents between 11.4 and 20.9 years of age from the first 3 waves of the National Longitudinal Study of Adolescent Health, we investigated the longitudinal effects of future orientation on levels of and developmental changes in problem behaviors, while controlling for the effects by impulsivity;…