Multiple-select multiple-choice items, or multiple-choice items with more than one correct answer, are used to quickly assess content on standardized assessments. Because there are multiple keys to these item types, there are also multiple ways to score student responses to these items. The purpose of this study was to investigate how changing the…

The digital divide has been an issue in California for decades. Its contours in the educational realm emerged more clearly than ever during the COVID-19 pandemic, when school facilities closed and instruction went online for nearly everyone. The Emergency Connectivity Fund (ECF) was a federal pandemic-relief program intended to improve digital…

This Technical Appendix accompanies the report "California School Districts and the Emergency Connectivity Fund", which examines the Emergency Connectivity Fund (ECF) program's history to determine which school districts applied for funding, what kinds of needs their students and constituent communities were facing at the time, and what…

The fundamental goal of the Third Grade Summer Reading Camp program in 2024 was to bolster the reading skills of struggling third grade students and to prepare them to demonstrate mastery of state standards needed to be promoted to the fourth grade. The Office of Program Evaluation undertook an evaluation to gauge whether students who completed…

The observation systems being used in all 50 states require administrators to learn to accurately and reliably score their teachers' instruction using standardized observation systems. Although the literature on observation systems is growing, relatively few studies have examined the outcomes of trainings focused on developing administrators'…

The use of a computer and internet connection allows high school and university students to access more relevant information. However, there is no consensus on the effects of the use of these tools on academic results. This work evaluates the impact of computers and the internet at home on the results of the Saber 11 test, a national exam taken by…

While both summative and formative assessments are necessary, finding the right balance can be challenging. The author examines the pros and cons of each and their reliance on one another.

Colleges across the country struggle with determining the most appropriate means of placing students into math and English coursework. Most colleges utilize a single high-stakes standardized placement exam to assess incoming students and use strict cut-scores to determine students' placement. However, the ability of these tests to accurately place…

Studies that focus on measurement invariance are of significant importance in proving the validation of high-stake tests, and in order to provide fairness from the results of these exams for special needs students. The aim of this study is to examine the measurement invariance of the "Central Examination for Secondary Education…

In this article we address the mounting criticism and rejection of standardized tests used in the selection of students for college or university education. Admission tests are being increasingly demonized in many parts of the world and many colleges and universities are dropping tests for selection purposes, claiming the tests are detrimental to…

Individual differences in self-regulation have been a topic of increased empirical research. However, few investigations have been conducted on how sub-components of self-regulation differentially predict education outcomes over time. We examined cognitive and behavior regulation as predictors of middle-school students' (n = 127) long-term…

Many seem to believe that researcher-made tests are unnecessary, if not inappropriate, for evaluating reading comprehension interventions. We suggest that this view reflects a zeitgeist in which researcher-made (proximal) tests that align with the researchers' interventions are closely scrutinized and often devalued, whereas commercially developed…

The purpose of this study was to investigate the Next Generation Science Standards (NGSS) and its implications of being a curricular and pedagogical intervention in terms of narrowing the achievement gap in science education for Children of Color. In using the explanatory mixed methods design, standardized test data and one-on-one interviews were…

A recent study in our research group found that social comparison concern (SCC) was a medium strength predictor of course grades while controlling for demographic factors and standardized test scores. Additionally, students belonging to underrepresented communities (women and Underrepresented ethnic minorities) had significantly higher SCC than…

The purpose of this study is to examine how validity has been presented in technical and other users' manuals for various editions (i.e., revisions) of the same commercially published test over time. Although the unitary view of validity came to prominence more than 30 years ago and has been embraced in the "Standards for Educational and…