With recent technological advances, researchers have begun to explore the potential use of spoken dialog systems (SDSs) for L2 oral communication assessment. While several studies support the feasibility of building these systems for various types of oral tasks, research on the construct validity of SDS-delivered tasks is still limited. Thus, this…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition,…

The following report describes an assessment instrument called the Mathematics Performance and Cognition (MPAC) interview. The MPAC interview was designed to measure two outcomes of interest. It was designed to measure first and second graders' mathematics achievement in number, operations, and equality, and it was also designed to gather…

This report provides an overview of the development, implementation, and psychometric properties of a student mathematics interview designed to assess first- and second-grade student achievement and thinking processes. The student interview was conducted with 622 first- or second-grade students in 22 schools located in two public school districts…

Ausubel and Novak's construct of "meaningful learning" stipulates that substantive connections between new knowledge and what is already known requires the integration of thinking, feeling, and performance (Novak J. D., (2010), "Learning, creating, and using knowledge: concept maps as facilitative tools in schools and…

The goal of this study was to create and validate a brief multidimensional scale of teacher engagement--the Engaged Teachers Scale (ETS)--that reflects the particular characteristics of teachers' work in classrooms and schools. We collected data from three separate samples of teachers (total N = 810), and followed five steps in developing and…

In the current investigation, the authors examined the diagnostic construct validity of the "Minnesota Multiphasic Personality Inventory-2-Restructured Form" (MMPI-2-RF) in a patient sample. All participants were diagnosed via the "Structured Clinical Interview" for DSM-IV Axis I Disorders (SCID-I/P). The data set used in this…

The increased capabilities offered by digital technologies offer new opportunities to evaluate students' deeper knowledge and skills and on constructs that are difficult to measure using traditional methods. Such assessments can also incorporate tools and interfaces that improve accessibility for diverse students, as well as inadvertently…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Background: Interpersonal staff behaviour is one of the instigating factors associated with challenging behaviour in clients with intellectual disabilities (ID). There are several studies focusing on the influence of intrapersonal staff characteristics--such as beliefs, attributions and emotional reactions--on staff behaviour. Little is known,…

The "Multidimensional Attitudes toward Inclusive Education Scale" (MATIES) was developed to effectively measure affective, cognitive and behavioural aspects of attitudes, within the realm of inclusive education that includes physical, social and curricular inclusion. Models within Item Response Theory and Classical Test Theory were used…

Examined the validity of the Irrational Beliefs Inventory by administering various psychological instruments to 129 undergraduate students. Regarding construct validity, the Irrational Beliefs Inventory measured several variables measured by the Irrational Beliefs Test. With regard to concurrent validity, test anxiety was most strongly associated…

Emerging data support the construct validity of component process variables of learning and memory within the Hopkins Verbal Learning Test-Revised (HVLT-R; Brandt & Benedict, 2001); however, the test-retest reliabilities of such measures are heretofore largely unknown. This study reveals generally modest-to-low 1-year test-retest stability for…