Current methods for evaluating faculty teaching fall short, and one way to address this is through campus-wide initiatives that focus on change at the level of academic units. The complex context of higher education makes meaningful teaching evaluation difficult; in particular, four sobering realities of this context must be taken into account in…

Many students of statistics and econometrics express frustration with the way a problem known as "bad control" is treated in the traditional literature. The issue arises when the addition of a variable to a regression equation produces an unintended discrepancy between the regression coefficient and the effect that the coefficient is…

Merit-based procedures should be constantly reevaluated according to the circumstances to remain both valid and fair--two interrelated concepts. Inducing reevaluation, however, is difficult. These procedures are controlled by legitimate authorities, are rule and contract-bound, and can become quickly entrenched. This resistance to change calls for…

This module is designed for educators, educational researchers, and psychometricians who would like to develop an understanding of the basic concepts of validity theory, test validation, and documenting a "validity argument." It also describes how an in-depth understanding of the purposes and uses of educational tests sets the foundation…

In the past decade, the numeracy component in adult basic education has gained scholarly attention. The issue has been addressed by large-scale assessments of adults' skills and intergovernmental policy agendas, but also by qualitative research into numeracy from the perspective of social practice theory. However, some aspects of numeracy are…

In standardized educational testing, test items are reused in multiple test administrations. To ensure the validity of test scores, the psychometric properties of items should remain unchanged over time. In this article, we consider the sequential monitoring of test items, in particular, the detection of abrupt changes to their psychometric…

Research on spatial navigation is essential to understanding how mobile species adapt to their environments. Such research increasingly uses virtual environments (VEs) because, although VE has drawbacks, it allows for standardization of procedures, precision in measuring behaviors, ease in introducing variation, and cross-investigator…

Ten years ago, the author worked as the Director of Assessments for the District of Columbia Public Schools (DCPS). For temporal context, the author arrived after the first of the infamous test cheating scandals and left just before the incident that spawned a second. Indeed, the author filled a new position created to both manage test security…

Educators and researchers strive to build policies and practices on data and evidence, especially on academic achievement scores. When assessment scores are inaccurate for specific student populations or when scores are inappropriately used, even data-driven decisions will be misinformed. To maximize the impact of the research-practice-policy…

Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores and hence to incomplete data on mastery tests such as the AP and U.S. Medical Licensing examinations. Investigators are often interested in estimating the probabilities of passing of the examinees with incomplete data on mastery tests.…

During the COVID-19 lockdown, schools are closed, exams have been cancelled, and teaching and learning are taking an unprecedented form. In this process, two realities are brought to light. On the one hand, the pandemic highlights the widening gaps in society and the part that the educational system plays in privileging students from advantageous…

International large-scale assessments (ILSAs) are one of the most important tools policymakers and other educational stakeholders have to inform evidence based decision making for educational reform. Despite this, and the widespread use of ILSA data, results are sometimes misunderstood or misinterpreted. Here, we offer a brief guide to ILSAs and…

The Elementary and Secondary Education Act (ESEA), as amended by Section 3113 of the Every Student Succeeds Act (ESSA), requires state educational agencies (SEAs) to establish and implement standardized, statewide entrance and exit procedures for English learners (ELs). WIDA provides the English language proficiency placement and annual…

The Elementary and Secondary Education Act (ESEA), as amended by the Every Student Succeeds Act (ESSA), requires state education agencies to establish and implement standardized, statewide entrance and exit procedures for English learners (ELs). WIDA provides the English language proficiency placement and annual assessments administered in…

This article presents a historical and contemporary account of Lithuania's national public education assessment system and its transformation since the country's declaration of independence from the Soviet Union in 1990. We explore how the external examination system has developed in relation to ongoing curriculum reforms over the last 30 years,…