State education agencies are sitting on rich repositories of quantitative and qualitative assessment data. This document is designed to provide a conceptual framework and implementation guidance that can help agency leadership leverage and interrogate student performance data in systematic ways for reporting, outreach, and planning purposes. The…

This study has three primary objectives. First to provide insight into possibilities for moderation/mediation analysis in education research by discussing analytical methods based on the counterfactual and developed in other disciplines. Second is to highlight specific issues related to mediation and the estimation of effects when the outcome is…

A small subset of education studies analyzes school data collected seasonally (separating the summer from the school year). At first, this work was primarily known for documenting learning loss in the summers, but scholars have since recognized that observing how inequality changes between summer and school periods provides leverage for…

Single-case research design is a useful methodology for evaluating the presence of a functional relation between an intervention and the mathematical performance of students with a learning disability. However, a functional relation cannot be established with threats to internal validity of the design. External validity is impacted if researchers…

Research has shown that mathematical proficiency gaps are related to students' and schools' indicators of poverty, with fewer studies on neighborhood effects on achievement gaps. Although this literature has accounted for students' nesting within schools, so far, methodological constraints have not allowed researchers to formally account for…

Educational technology (EdTech) designers need to ensure population validity as they attempt to meet the individual needs of all students. EdTech researchers often have access to larger and more diverse samples of student data to test replication across broad demographic contexts as compared to either the small-scale experiments or the larger…

The Stanford Educational Data Archive (SEDA) is the first data set to allow comparisons of district academic achievement and growth from Grades 3 to 8 across the United States, shining a light on the distribution of educational opportunities. This study describes a convergent validity analysis of the SEDA growth estimates in mathematics and…

This three-article dissertation considers the pedagogical practices for developing statistically literate students and teaching data-driven decision-making with the goal of preparing students for civic engagement and improving student achievement. The first article discusses a critical review of the literature on data-driven decision-making…

Is physics education research based on a representative sample of students? To answer this question we skimmed physics education research papers from three journals for the years 1970-2015 looking for the number of research subjects, the course the subjects were enrolled in, and the institution where the research was conducted. We combined this…

Data mining has been successfully used by financial and retail companies since the mid-1960's to create predictive models and reveal unexpected relationships. However, it remains underutilized as a tool in educational research. Large-scale standardized assessment programs such as the Trends in International Mathematics and Science Study (TIMSS)…

This chapter provides a discussion on how the Singapore education system uses evidence from educational research conducted both locally and internationally, to shape policies and initiatives that can effectuate the "common good". In addition to research outcomes, the Singapore Ministry of Education also takes into consideration the…

The NEAIR 2015 Conference Proceedings is a compilation of papers presented at the Burlington, VT, conference. Papers in this document include:(1) Strategies to Analyze Course and Teaching Evaluation Data (Kati Li); (2) Using a Mixed Methods Approach to Assess a Leadership Mentoring Program (Betty Harper); (3) Flagship Institutions and the Struggle…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

With COVID-19 continuing to make meeting face-to-face impossible, the Canadian Mathematics Education Study Group/Groupe Canadien d'Étude en Didactique des Mathématiques (CMESG/GCEDM) executive decided that, for the first time, the CMESG/GCEDM meeting would be held virtually. By necessity, the program had to be much compressed with no topic…

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and…