We study the external validity of instrumental variable estimation. The key assumption we impose for external validity is conditional external unconfoundedness among compliers, which means that the treatment effect and target selection are independent among compliers conditional on covariates. We study this assumption with a case study about the…

Cross-validation is a common statistical procedure applied to problems that are otherwise computationally intractable. It is often employed to assess the effectiveness of prediction procedures. In this report, cross-validation is discussed in terms of "U"-statistics. This approach permits consideration of the statistical properties of…

The Program for the International Assessment of Adult Competencies (PIAAC) is a multicycle survey of adult skills and competencies sponsored by the Organization for Economic Cooperation and Development (OECD). The survey examines a range of basic skills in the information age and assesses these adult skills consistently across participating…

We proposed an extended form of the Govindarajulu and Barnett margin of error (MOE) equation and used it with an analysis of variance experimental design to examine the effects of aggregating student evaluations of teaching (SET) ratings on the MOE statistic. The interpretative validity of SET ratings can be questioned when the number of students…

In causal matching designs, some control subjects are often left unmatched, and some covariates are often left unmodeled. This article introduces "rebar," a method using high-dimensional modeling to incorporate these commonly discarded data without sacrificing the integrity of the matching design. After constructing a match, a researcher…

The overall aim of this paper is to provide an epistemological rational for the measurement of intentionality. The purpose of this narrative is to identify "Intentionality" as an arena of action in the dispositional learning domain can be measured using an "Intentionality Measurement Instrument" [also referred by the acronym…

Nonoverlap is widely used as a statistical summary of data; however, these analyses rarely correct unwanted positive baseline trend. This article presents and validates the graph rotation for overlap and trend (GROT) technique, a hand calculation method for controlling positive baseline trend within an analysis of data nonoverlap. GROT is…

With widespread adoption of Learning Management Systems (LMS) and other learning technology, large amounts of data--commonly known as trace data--are readily accessible to researchers. Trace data has been extensively used to calculate time that students spend on different learning activities--typically referred to as time-on-task. These measures…

This article provides a detailed discussion of the theory and practice of modern regression discontinuity (RD) analysis for estimating the effects of interventions or treatments. Part 1 briefly chronicles the history of RD analysis and summarizes its past applications. Part 2 explains how in theory an RD analysis can identify an average effect of…

The principle of "inversion," that a + b - b "must" equal a, is a fundamental property of arithmetic, but many children fail to apply it in symbolic contexts through 10 years of age. We explore three hypotheses relating to the use of inversion that stem from a model proposed by Siegler and Araya (2005). Hypothesis 1 is that…

The purpose of the current research was to investigate the relationship between preference for numerical information (PNI), math self-concept, and six types of statistics anxiety in an attempt to establish support for the nomological validity of the PNI. Correlations indicate that four types of statistics anxiety were strongly related to PNI, and…

Oklahoma is one of 16 states electing to use an A-F letter grade as an indicator of school quality. On the surface, letter grades are an attractive policy instrument for school improvement; they are seemingly clear, simple, and easy to interpret. Evidence, however, on the use of letter grades as an instrument to rank and improve schools is scant…

To compare two modes of administration (self-administered; by interviewer) and two response options format (using words; images of "facial-expressions") of the first question of SF-36 (Q1SF-36), and to test its validity. We included 825 participants (20-90 years). Q1SF-36, using words or images, was included in a global questionnaire interview and…

Like many journals within education, for "Multicultural Learning and Teaching," this writer found little written on measurement, effect sizes, and confidence intervals; therefore, the purpose of this article is to address these factors. The effect of not addressing these issues is that a basic foundation of science cannot be established…

Oral reading tasks and Maze reading tasks are often used interchangeably to assess the level and rate of reading skill development. This study examined the concurrent validity of growth estimates derived from "Curriculum-Based Measurement of Oral Reading" (CBM-R) and "Maze Reading" (CBM-mR). Participants were 1,528 students…