The main points of Sijtsma and Green and Yang in Educational Measurement: Issues and Practice (34, 4) are that reliability, internal consistency, and unidimensionality are distinct and that Cronbach's alpha may be problematic. Neither of these assertions are at odds with Davenport, Davison, Liou, and Love in the same issue. However, many authors…

This article presents principles and practices of effective assessment, outlining seven key concepts--usefulness, reliability, validity, practicality, washback, authenticity, and transparency--and demonstrating how to apply them in creating an exam blueprint. The article also discusses the importance of providing feedback after a test has been…

Awareness is one of the most frequently measured construct by masters' students in education for their dissertation work. The author has observed that within the jurisdiction of his home university frequency of dissertations in education using "Awareness of" some social scientific or educational topic will be anywhere between 10 to…

The Barkley Deficits in Executive Functioning Scale (BDEFS), authored by Russell A. Barkley and published by Guilford in 2011, is an individually administered assessment tool that may be used to evaluate adults ages 18 to 81. The purpose of this measure is to screen those who may be experiencing executive functioning (EF) deficits in…

This paper outlines the use of item analysis to assist examiners in evaluating the quality and validity of their MCQ exam questions. The generation of item analysis, particularly discrimination index, has long been established practice in professional testing and credentialing organisations and some disciplines in tertiary education, but its use…

This article describes how assessments in PE Metrics were developed following six steps: (a) determining test blueprint, (b) writing assessment tasks and scoring rubrics, (c) establishing content validity, (d) piloting assessments, (e) conducting item analysis, and (f) modifying the assessments based on analysis and expert opinion. A task force,…

The experience of the International Society of Addiction Medicine in setting up the first international certification of clinical knowledge is reported. The steps followed and the results of a psychometric analysis of the tests from the first 65 candidates are reported. Lessons learned in the first 5 years and challenges for the future are…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

This article proposes procedures for simultaneously assessing and controlling acquiescence and social desirability in questionnaire items. The procedures are based on a semi-restricted factor-analytic tridimensional model, and can be used with binary, graded-response, or more continuous items. We discuss procedures for fitting the model (item…

Standards-based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments--their instructional sensitivity--is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the…

In arguing for more comprehensive practice, policy and research considerations of assessment in physical education (PE), this paper outlines and discusses four integrated conditions of assessment efficacy for the development and promotion of productive assessment in PE. These conditions are prefaced by the proposition that quality PE requires the…

The authors describe the development and validation of the Avoidance and Fusion Questionnaire for Youth (AFQ-Y), a child-report measure of psychological inflexibility engendered by high levels of cognitive fusion and experiential avoidance. Consistent with the theory underlying acceptance and commitment therapy (ACT), items converged into a…

This article examines three typical approaches to alternate assessment for students with significant cognitive disabilities--portfolios, performance assessments, and rating scales. A detailed analysis of common and unique design features of these approaches is provided, including features of each approach that influence the psychometric quality of…

This article proposes and describes factor-analytic procedures for assessing and controlling socially desirable responding in binary personality items. The basic procedures are applications of the restricted (confirmatory) item factor analysis model for ordered-categorical variables. Orthogonal and oblique solutions based on marker variables are…

This article is the second contribution to a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information that decision makers can use with confidence when conducting program evaluation and policy…