New knowledge tracing models are continuously being proposed, even at a pace where state-of-the-art models cannot be compared with each other at the time of publication. This leads to a situation where ranking models is hard, and the underlying reasons of the models' performance -- be it architectural choices, hyperparameter tuning, performance…

Three mode comparability studies were conducted on the following Saturday national ACT test dates: October 26, 2019, December 14, 2019, and February 8, 2020. The primary goal of these studies was to evaluate whether ACT scores exhibited mode effects between paper and online testing that would necessitate statistical adjustments to the online…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

The ED School Climate Surveys (EDSCLS) are a suite of survey instruments being developed for schools, school districts, and states by the U.S. Department of Education's National Center for Education Statistics (NCES). Through the EDSCLS, schools nationwide will have access to survey instruments and a survey platform that will allow for the…

Federal initiatives and other research have led states across the nation to sharpen their focus on teacher evaluation in recent years. In 2009 a seminal report, "The Widget Effect," from The New Teacher Project revealed that in districts using a binary rating system to evaluate teachers, less than 1 percent of teachers received an…

The Research Alliance for New York City Schools examined Department of Education (DOE) School Survey data from 2008-2010 to better understand the richness and complexities of the information elicited by the Survey from parents, students, and teachers. This document provides the appendices to the technical report "New York City School Survey…

The New York City Department of Education's (DOE) annual survey of parents, students, and teachers is the largest of its kind in the United States. The DOE relies on the survey to identify schools' strengths and to target areas for improvement. School Survey scores, along with attendance, are also the only non-academic indicators used in the DOE's…

Little research has been conducted on the effectiveness of training strategies for child care providers. The current study used an experimental intent-to-treat design to measure the impact of an established intervention, the on-site caregiver training component of the Program for Infant/Toddler Care (PITC), on child development and child care…

International studies like PISA use context student or school questionnaires to collect data on student family background, attitudes and learning context. Questionnaire constructs are typically measured using dichotomous or Likert-type items. Scaling of questionnaire items in order to obtain measures of family background, student attitudes or…

This technical report describes the development, pilot testing, and revision of a survey instrument designed to measure secondary school teachers' perceptions of their efficacy working with students from diverse backgrounds. A brief review of relevant literature frames the current study in the context of survey development that is technically…