For a number of reasons, increasing reliance is being placed on teacher assessment in high-stakes contexts in many countries around the world. Simultaneously, countries that have for some time relied to greater or lesser degrees on teacher assessment for high-stakes purposes are in the process of questioning the validity of that reliance. In…

Research on the relationship between affect and cognition in Artificial Intelligence in Education (AIEd) brings an important dimension to our understanding of how learning occurs and how it can be facilitated. Emotions are crucial to learning, but their nature, the conditions under which they occur, and their exact impact on learning for different…

Research has shown that a student's level of institutional integration is a better predictor of college persistence than academic performance (Pascarella & Terenzini, 1980). Tinto (1975) proposed that institutional integration is the student's perception of his/her fit to the university he/she is attending. Student athletes are a unique…

The purpose of this study was to explore the effect of instrument-specific rater training on interrater reliability (IRR) and counseling skills performance differentiation. Strong IRR is of primary concern to effective program evaluation (McCullough, Kuhn, Andrews, Valen, Hatch, & Osimo, 2003; Schanche, Nielsen, McCullough, Valen, &…

Mentoring research to date focuses on outcomes related to program goals and theoretical background, and almost all of these relate to the experience of the mentee. Very little research has been completed on the other side of the dyad--the mentor--despite the fact that mentor expectations and experience contribute significantly to the perceived…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

Fidelity assessment has received renewed attention in recent years, particularly as distinctions have been made in implementation science between intervention fidelity and implementation fidelity. Considering both types of fidelity has been recommended when developing fidelity instruments. In the present article, we describe development of the…

Argumentation in mathematics teaching has potential to move students beyond tacit understanding of mathematical concepts and procedures towards articulation and justification of their ideas; a practice in which evidence is central. Design-based research was used to examine the nature of evidence used by a class of primary students through levels…

Fidelity assessment has received renewed attention in recent years, particularly as distinctions have been made in implementation science between intervention fidelity and implementation fidelity. Considering both types of fidelity has been recommended when developing fidelity instruments. In the present article, we describe development of the…

Research on childhood posttraumatic stress disorder (PTSD) is sparse. This is partly due to the limited availability of empirically validated measures for children who are insecure readers. The present study examined the reliability and validity of a cartoon-based measure of PTSD symptoms in children exposed to a disaster. Cartoons were generated…

Existing instruments designed to measure mathematics attitudes were too long, dated, or assessed with only western samples. To address this issue, a shortened version of the Attitudes Toward Mathematics Inventory (short ATMI) which measures four subscales--;enjoyment of mathematics, motivation to do mathematics, self-confidence in mathematics, and…

Researchers interested in exploring substantive group differences are increasingly attending to bundles of items (or testlets): the aim is to understand how gender differences, for instance, are explained by differential performances on different types or bundles of items, hence differential bundle functioning (DBF). Some previous work has…

Implicit race/ethnic prejudice was assessed using Spanish- and English-language versions of an Implicit Association Test that used Hispanic/Anglo first names and pleasant/unpleasant words as stimuli. This test was administered to a consecutive sample of Mexican American adults residing in the Rio Grande Valley region of Texas of whom about…

The current study served to extend previous research on scaling construction of Direct Behavior Rating (DBR) in order to explore the potential flexibility of DBR to fit various intervention contexts. One hundred ninety-eight undergraduate students viewed the same classroom footage but rated student behavior using one of eight randomly assigned…

The search for fairness in language testing is distinct from other areas of educational measurement as the object of measurement, that is, language, is part of the identity of the test takers. So, a host of issues enter the scene when one starts to reflect on how to assess people's language abilities. As the quest for fairness in language testing…