Measuring opportunities to learn (OTL) is crucial for evaluating education quality and equity, but obtaining accurate and comprehensive OTL data at a large scale remains challenging. We attempt to address this issue by investigating measurement concerns in data collection and sampling. With the primary goal of estimating group-level OTLs for large…

This paper reports on students' experiences of describing and representing variation in hypothetical data. Fifty-six students (8-9 years-old) experienced collecting and working with quantitative data for two years as part of a STEM education project. The task described here was an end-of-year survey question, with three parts about a hypothetical…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

These are the appendices for the report "The Effects of an Academic Language Program on Student Reading Outcomes." This study investigated WordGen Elementary, a program designed to improve fourth- and fifth-grade students' ability to understand and communicate academic language and their general reading skill. The program provider…

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of fourth- and fifth-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations…

Trends in International Mathematics and Science Study (TIMSS) is an international comparative study designed to measure trends in mathematics and science achievement at grades 4 and 8, as well as to collect information about educational contexts (such as students' schools, teachers, and homes) that may be related to student achievement. TIMSS has…

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel…

Prospective longitudinal data collection is an important way for researchers and evaluators to assess change. In school-based settings, for low-risk and/or likely-beneficial interventions or surveys, data quality and ethical standards are both arguably stronger when using a waiver of parental consent--but doing so often requires the use of…

In many countries, assessment and curriculum reforms came into being in recent decades. In Iran, an important educational assessment reform took place called Descriptive Assessment (DA). In this reform, the focus of student assessment was moved from a more summative approach of providing grades and deciding about promotion to the next grade to a…

The purpose of this study was to investigate the effect of a heart rate measurement system on student motivation and parent satisfaction of the information obtained. Participants (n=27) either took a survey as a parent/guardian (n=11) or were interviewed as a student (n=16). The survey was based on a qualitative measure and used to determine the…

Stealth assessment has been successfully embedded in educational games to measure students' learning in an unobtrusive and supportive way. This study explored the possibility of applying stealth assessment in a digital reading platform and sought to identify potential in-system indicators of students' digital learning outcomes. Utilizing the user…

Interdisciplinary studies foster integration of ideas across disciplines. The knowledge building pedagogy, with its 12 principles and associated technology, Knowledge Forum®, provides multifaceted support for linking ideas across disciplines and communities. This exploratory study aims to assess the extent to which elementary-school students…

Within multitiered systems of support, assessment practices that limit the amount of time students miss instruction should be prioritized. At the same time, decisions about student response to intervention need to be based upon technically adequate data. We evaluated the impact of data collection frequency and trend estimation method on the…

This study presented a secondary analysis of the National Assessment of Educational Progress (NAEP) dataset. The paper explored the differences between fourth grade reading scores by examining (1) how often the fourth graders discuss their school work at home with family and (2) how often the fourth graders discuss what they were reading with…

Although extensive research exists on the use of curriculum-based measures for progress monitoring, little is known about using computer adaptive tests (CATs) for progress-monitoring purposes. The purpose of this study was to evaluate the impact of the frequency of data collection on individual and group growth estimates using a CAT. Data were…