This focus article provided the author with an opportunity to unpack the consensus definition of validity and to explore its implications in the light of recent debates. He proposed an elaboration of the consensus definition, which was intended to express the spirit of the "Standards for Educational and Psychological Testing" with increased…

The emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed…

This study describes the development of an instrument to investigate the extent to which technology is integrated in science instruction in ways aligned to science reform outlined in standards documents. The instrument was developed by: (a) creating items consistent with the five dimensions identified in science education literature, (b)…

In a Distance Education (DE) system, students must be equipped with seven skills of computer (ICDL) usage. This paper aims at investigating the effect of a DE system on the computer literacy of Master of Arts students at Tehran University. The design of this study is quasi-experimental. Pre-test and post-test were used in both control and…

The introduction of Free Primary Education (FPE) policy in 2003 was aimed at enhancing the enrolment of all school going-age children in Kenya indiscriminately. However, significant concerns have been raised by scholars and the public over the low enrolment of children with Special Needs Education (SNE). The main objective of this study was to…

Using an iterative design along with multiple methodological approaches and a large representative sample, this study presents reliability, validity, and fairness evidence for two surveys measuring student attitudes toward science, technology, engineering, and math (S-STEM) and interest in STEM careers for (a) 4th- through 5th-grade students…

Drawing from research on situated cognition and the development of expertise and simulations in professional education, we designed two simulation tasks that provided novice teachers with repeated opportunities to deliberately practice managing a classroom under no-fault conditions. The simulations immersed novices in two perennial classroom…

The purpose of the study is to analyze high school English curriculum materials (ECM) through FACETS analysis and MAXQDA-11 programs. The mixed methods approach, both quantitative and qualitative methods, were used in three samples including English teachers in Elazig during the 2014-2015 academic year. While the quantitative phase of the study…

The purpose of this report is to explore the content-related validity evidence supporting the English language arts (ELA) components of the "ETS"® National Observational Teaching Exam (NOTE) assessment series, a kindergarten through 6th-grade teacher licensure assessment. To establish the content knowledge required for the effective…

Given the social, emotional, and academic benefits of physical activity related to youth development (Hellison, 2011), coupled with the minimal research regarding how school counselors can use physical activity for life skill development, this article focuses on school counselors' beliefs about collaborating with coaches and using physical…

This paper presents the authors' critique on "Clarifying the Consensus Definition of Validity" by Paul E. Newton (this issue). There are serious differences of opinion regarding the topic of validity. Newton is aware of these differences, as made clear by his choice of references and particularly his effort to respond to the various Borsboom…

Language testers operate within two frames of reference: norm-referenced (NRT) and criterion-referenced testing (CRT). The former underpins the world of large-scale standardized testing that prioritizes variability and comparison. The latter supports substantive score meaning in formative and domain specific assessment. Some claim that the…

This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

This paper describes efforts to bring principled assessment design to a large-scale, high-stakes licensure examination by employing the frameworks of Assessment Engineering (AE), the Revised Bloom's Taxonomy (RBT), and Cognitive Task Analysis (CTA). The Uniform CPA Examination is practice-oriented and focuses on the skills of accounting. In…

Honors education has grown exponentially across the country, and a great deal of variation currently exists among programs. The National Collegiate Honors Council (NCHC) has adopted lists of the Basic Characteristics of Fully Developed Honors Programs (Madden, 1994) and Honors Colleges (Sederberg, 2005) to guide new and developing programs, but no…