This paper aims to identify and compare key factors influencing US States' or an OECD country's decision to employ student test scores or test score value-added (VAM) in evaluating teacher effectiveness. Analysis using multiple linear probability model and logistic regression frameworks indicates that the use of VAM/student test scores was…

In the last two decades, the US has made remarkable strides in closing long-standing gender inequities in academic achievement in STEM (science, technology, engineering, and math) fields. However, new data suggest these hard-won gains may be unraveling. During the COVID-19 pandemic, girls showed substantially larger declines in math and science…

The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

The purpose of this technical appendix is to more fully describe the sample, methods, and results of the research brief "Boys Regain the Advantage in Middle School STEM Skills: Post-COVID Trends in Gender Achievement Gaps." The authors investigated three research questions in this brief: (1) How have 8th grade gender gaps in STEM…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

According to the National Assessment of Educational Progress (NAEP), US reading and math scores have recently dropped. This decline is believed to be the result of the school closings that occurred during the COVID-19 pandemic. The drop likely contributed to the increase in pressure educators are feeling to teach in a way that leads to higher test…

Gender differences in math-related professional achievements have been identified as a worldwide problem. Academic achievement assessments, however, have repeatedly revealed gender similarities. The observed gender similarity might be due to biased assessments that heavily rely on reading skills, which favors girls. The current study analyzed 29…

This chapter offers an integrated review and discussion of the major advances in theory and practice in the area of literacy, with particular focus on the work since 2014 onward. For the purposes of this review, it approaches Literacy as the ability to read and write. For reading, the chapter highlights theoretical advances that expand the view of…

State education agencies are sitting on rich repositories of quantitative and qualitative assessment data. This document is designed to provide a conceptual framework and implementation guidance that can help agency leadership leverage and interrogate student performance data in systematic ways for reporting, outreach, and planning purposes. The…

Background/Context: Impact evaluations of schooling reforms in developing countries typically focus on tests of student achievement that are designed and implemented by researchers. Are these tests any good? What practical and principled guidance should researchers in the field follow? We aim to answer these questions. Test scores have, of course,…

Rising inequality in the United States has raised concerns about potentially widening gaps in educational achievement by socioeconomic status (SES). Using assessments from LTT-NAEP, Main-NAEP, TIMSS, and PISA that are psychometrically linked over time, we trace trends in SES gaps in achievement for U.S. student cohorts born between 1961 and 2001.…

Concerns about the breadth of the U.S. income distribution and limited intergenerational mobility have led to a focus on educational achievement gaps by socio-economic status (SES). Using intertemporally linked assessments from NAEP, TIMSS, and PISA, we trace the achievement of U.S. student cohorts born between 1954 and 2001. Achievement gaps…

When judging subject-specific aspects of students' texts, teachers should assess various characteristics, e.g., spelling and content, independently of one another since these characteristics are indicators of different skills. Independent judgments enable teachers to adapt their classroom instruction according to students' skills. It is still…

In this paper we describe content focused, practical procedures to establish benchmarked performance standards for educational and other tests. To implement our procedures, we identify one or more external benchmark (e.g., NAEP or PISA performance levels, college and career readiness benchmarks); link to the external benchmarks to locate those…