This article proposes and demonstrates a methodology for test score validation through abductive reasoning. It describes how abductive reasoning can be utilized in support of the claims made about test score validity. This methodology is demonstrated with a real data example of the Canadian English Language Proficiency Index Program…

Validity in the context of qualitative research may take on many different definitions depending on the philosophical perspective. When a researcher conducts research within their place of employment, this will also influence the approach and interpretation. Insider research has been under scrutiny for the very fact that the insider is an actor…

The Comprehensive English Regents Exam, also referred to as the English Language Arts (ELA) Examination, is a widely used measure of student achievement in the K-12 system in New York, yet it is not without criticism. One concern is that the ELA Regents Exam may be contributing to the widening of the gap in graduation rates between English…

In too many districts, evaluation of teachers ensures competence but does little or nothing to encourage and support expertise. In this thought-provoking and groundbreaking book, Tony Frontier and Paul Mielke address this issue head-on, combining the conceptual and the practical by offering a compelling vision of teacher growth, along with nearly…

Associations between scale scores obtained from a teacher observation-based authentic assessment measure, the "Teaching Strategies GOLD®", and (a) teacher ratings of children's social functioning and learning behaviors, and (b) child performance on external, individually administered direct assessments of academic skills are presented.…

Rigorous longitudinal research demonstrates that certain Mindsets, Essential Skills, and Habits (MESH) can help students succeed in college, career, and life. Assessing students' MESH competencies can give educators valuable information that helps them understand students' strengths and identify the areas in which students need additional support.…

Over the past five years, policymakers have shown a renewed interest in using teacher evaluation as a lever for increasing the quality of the teacher labor market. As such, states have been spurred by federal policies such as Race to the Top and influential foundations such as the Bill & Melinda Gates Foundation to use a more reliable, more…

Organizational innovation involves reconciling many contradictions or paradoxes. Dividing the process of innovation into phases ranging from Activation to Validation and examining each phase in terms of the six Ps of creativity offers a framework for making sense of these contradictions. The Innovation Phase Assessment Instrument (IPAI) was…

Purpose: A microlinguistic content analysis for assessing lexical semantics in people with aphasia (PWA) is lexical diversity (LD). Sophisticated techniques have been developed to measure LD. However, validity evidence for these methodologies when applied to the discourse of PWA is lacking. The purpose of this study was to evaluate four measures…

Assessment engineering is a new way to design and implement scalable, sustainable and ideally lower-cost solutions to the complexities of designing and developing tests. It represents a merger of sorts between cognitive task modeling and engineering design principles--a merger that requires some new thinking about the nature of score scales, item…

Behavioral mapping, a method designed to relate behaviors to circumplex models, was used to examine the predictive validity of the International Personality Item Pool-Interpersonal Circumplex (IPIP-IPC). In this study, 96 participants first completed the IPIP-IPC and then were videotaped in a social interaction with a confederate. At the…

Numerous studies suggest spirituality and subjective well-being (SWB) are positively associated. However, critics argue that popular spirituality instruments--including the Daily Spiritual Experiences Scale (DSES)--contain items that conflate religiosity/spirituality (R/S), prosociality and SWB. Advocates of the DSES retort that, despite this…

The research aimed to 1) study the needs in developing indigenous history for diversity students in Northern Thailand, 2) develop indigenous history learning resources for diversity students in Northern Thailand through area-based participatory action learning of social studies pre-service teachers, and 3) distill learned lessons obtained from…

One tool that many families own, across the globe, is a basic mobile phone. The use of low-cost basic mobile phones for educational purposes in humanitarian settings is critical where access to connectivity and higher cost devices is limited. The portability of mobile phones, combined with their communication features, offers multiple uses to…

This article presents the author's response to Paul E. Newton's paper titled "Clarifying the Consensus Definition of Validity" ("Measurement: Interdisciplinary Research and Perspectives," 2012). Newton's paper offers an interesting and constructive discussion about how people think about validity. In this reaction, the author comments on some of…