The present study explores the sources of validity evidence of the mathematics self-concept construct in Programme for International Student Assessment (PISA) 2022 with a focus on concurrent, discriminant, and predictive evidence. Mathematics self-concept was provided with a single index variable in PISA 2022. Using only the U.S. students who…

The purpose of this study was to compare the classification accuracy of data produced by the previous year's end-of-year New York state assessment, a computer-adaptive diagnostic assessment ("i-Ready"), and the gating combination of both assessments to predict the rate of students passing the following year's end-of-year state assessment…

YouthTruth is a national survey project that harnesses student and stakeholder feedback to help guide decision-making by school leaders and education funders. With a grant from the Fund for Shared Insight, YouthTruth partnered with SRI Education to examine the relationship between key student experience scales and school-level academic and…

Using data from students in Grades 3-8 in school years 2018-2019 (N = 1,871) and 2021-2022 (N = 1,740), we examined the strength of fall math screening using Measures of Academic Progress (MAP) for predicting end-of-year state math assessment performance levels and whether this prediction varied across English language proficiency (ELP). In…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

Mathematical conjectures and theorems are most often of the form P(x) ? Q(x), meaning ?x,P(x) ? Q(x). The hidden quantifier ?x is crucial in understanding the implication as a statement with a truth value. Here P(x) and Q(x) alone are only predicates, without truth values, since they contain unquantified variables. But standard textbook…

Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and…

Measuring the implementation fidelity (IF) or integrity of interventions is crucial, otherwise a positive or negative outcome cannot be interpreted. Direct and indirect methods of IF measurement tend to over-emphasize teacher behaviour. This paper focuses on IF measured by student behaviour collected through computers. Attainment was measured by…

Different uses of the ACT Assessment emphasize different intervals on its 1-36 score scale. Its use by colleges for applicant selection and course placement emphasize the middle and upper intervals of its score scale, and these uses have been extensively validated (ACT, 2019a). Its uses by school districts and state departments of education to…

Two studies were conducted to examine and compare the construct validity of scores on the Junior Metacognition Awareness Inventory (JMAI) and problem-solving interview protocols. Participants consisted of 183 middle and high school students attending a university summer program for academically talented youth. Study 1 results indicated that JMAI…

We used multilevel analysis to examine the predictive validity of scores from the Framework for Teaching (FFT), the observation measure used most often to evaluate teachers' instruction. We investigated how well 81 kindergarten teachers' FFT scores for eight reading and eight mathematics lessons observed throughout the year predicted students'…

Knowledge tracing is a fundamental area of educational data modeling that aims at gaining a better understanding of the learning occurring in tutoring systems. Knowledge tracing models fit various parameters on observed student performance and are evaluated through several goodness of fit metrics. Fitted parameter values are of crucial interest in…

Policy makers, school practitioners, and scholars around the world have been searching for better school improvement models. The purpose of this study was to understand how an instrument we developed, Orientation to School Renewal, can be used to predict school-level academic achievement. We used the instrument to predict the academic performance…

District and state education leaders frequently use screening assessments to identify students who are at risk of performing poorly on end-of-year achievement tests. This study examines the use of a universal screening assessment of reading skills for early identification of students at risk of low achievement on nationally normed tests of reading…

This Center for American Progress report examines whether states' adoption of standards-based policies predicts low-income students' NAEP achievement trends in fourth and eighth grade math and reading throughout the 2003-2013 decade. The report claims to analyze changes across five separate two-year intervals, but it only reports findings for…