The quality of exams drives test-taking behavior of examinees and is a proxy for the quality of teaching. As most university exams have strict time limits, and speededness is an important measure of the cognitive state of examinees, this might be used to assess the connection between exams' quality and examinees' performance. The practice of…

The Bayesian information criterion (BIC) can be useful for model selection within multilevel modeling studies. However, the formula for BIC requires a value for N, which is unclear in multilevel models, since N is observed in at least two levels. The present study uses simulated data to evaluate the rate of false positives and power when using a…

There have been increasing calls for applied researchers to see and utilize effect sizes as the primary outcomes of their research. However, this sometimes places a methodological burden on researchers whose primary interests are substantive. Motivated by a desire to help applied researchers better report effect sizes and their confidence…

This paper drills deeper into the documented effects of the Cognitive Tutor Algebra I and ASSISTments intelligent tutoring systems by estimating their effects on specific problems. We start by describing a multilevel Rasch-type model that facilitates testing for differences in the effects between problems and precise problem-specific effect…

Research about the development of the graphomotor side of writing is very scarce. The goal of this study was to gain a better understanding of what constitutes graphic complexity of written material by determining the impact of graphic characteristics on handwriting production. In this end, the pen stroke of cursive handwriting was precisely…

Recent studies show cluster randomized trials may be well powered to detect mediation or indirect effects in multilevel settings. However, literature has rarely provided guidance on designing cluster-randomized trials aim to assess indirect effects. In this study, we developed closed-form expression to estimate the variance of and the statistical…

Multiple-baseline studies provide meta-analysts the opportunity to compute effect sizes based on either within-series comparisons of treatment phase to baseline phase observations, or time specific between-series comparisons of observations from those that have started treatment to observations of those that are still in baseline. The advantage of…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

Collaborative and individual learning are both frequently used in classrooms to support learning. However, little research has investigated the benefits of combining individual and collaborative learning, as compared to learning only individually or only collaboratively. With our study, we address this research gap. We compared a combined…

This is an extended conference proceedings report [Long Paper] based on a shorter contributed report at the same conference. A variety of computerized learning platforms exist. In mathematics, most include sets of problems to complete. Feedback to users ranges from a single word like "Correct!" to offers of hints and partially- to…

This study investigated effect of student- and school-level variables on mathematics achievement of fourth- and eighth-grade students using the Trends in International Mathematics and Science Study (TIMSS) 2011 data of Turkey. The common variables addressed in student and school questionnaires were compared. Due to nested structure of the TIMSS…