There is a clear call in group counseling practice and training for evidence-based practice (ACA, 2005; ASGW, 2008; CACREP, 2009). At the same time, group counselors also are asked to keep clients' experience at the center of their work (ASGW, 2012). This article outlines the authors' effort to develop and study an instrument designed to measure…

Background: In the context of a health intervention among people with intellectual disabilities (ID), there was a need to assess satisfaction with some aspects of life, in order to monitor both potential positive and negative effects of the intervention. The aim of the present study was to develop and evaluate an easily administered scale for…

The purpose of the present studies was to provide the means to create brief versions of instruments that can aid the diagnosis and classification of students with learning disabilities and comorbid disorders (e.g., attention-deficit/hyperactivity disorder). A sample of 1,108 students with and without a diagnosis of learning disabilities took part…

This two-stage study focused on the undergraduate nursing course that covers topics in general, organic, and biological (GOB) chemistry. In the first stage, the central objective was to identify the main concepts of GOB chemistry relevant to the clinical practice of nursing. The collection of data was based on open-ended interviews of both nursing…

Feedback was obtained on 683 teachers at 12 AISD schools from 9,000 pre-kindergarten through 12th grade students. Students' ratings were generally favorable and correlated with some observation-based ratings. Implications for policy are addressed.

Item pool quality has been regarded as one important factor to help realize enhanced measurement quality for the computerized adaptive test (CAT) (e.g., Flaugher, 2000; Jensema, 1977; McBride & Wise, 1976; Reckase, 1976; 2003; van der Linden, Ariel, & Veldkamp, 2006; Veldkamp & van der Linden, 2000; Xing & Hambleton, 2004). However, studies are…

This paper describes an expanded framework to aid chemical educators in constructing exams for their courses. The framework has three primary levels: definition, algorithmic, and conceptual. These primary levels have often been used in chemical education research to analyze and describe exam questions, but in this study the definition,…

In this article we provide an overview of the nature and scope of multisource feedback (MSF) and provide empirical evidence of its reliability, validity, and feasibility in one of the health professions. The overall internal consistency reliability (Cronbach alpha) of MSF instruments is generally greater than 0.96 for self and informants such as…

This paper provides an overview of evidence-centered assessment design (ECD) and some general information about of the Advanced Placement (AP[R]) Program. Then the papers in this special issue are discussed, as they relate to the use of ECD in the revision of various AP tests. This paper concludes with some observations about the need to validate…

Hooker, Finkelman, and Schwartzman ("Psychometrika," 2009, in press) defined a paradoxical result as the attainment of a higher test score by changing answers from correct to incorrect and demonstrated that such results are unavoidable for maximum likelihood estimates in multidimensional item response theory. The potential for these results to…

Assessments matter in education. Testing is nothing new; tests have been around as long as school itself. However, over the last 15 years, state assessments have grown to be an increasingly central, and often controversial, part of schooling. As states raise their standards, it is more important than ever to ask: What is a high-quality assessment?…

In the U.S., writing proficiency exams (WPEs) often employ a construct of writing proficiency that is based on U.S. English and essay-text literacy. As universities internationalize, they should reconsider whether such exams reflect the literacy requirements of a globalizing world. Since the ways in which universities respond to international…

In this essay I argue that the effects of federal policy can be examined through a scale analysis that helps deconstruct the effect of the current widespread accountability movement in the US educational system. I first discuss the concept of scale, including its thus-far limited use in educational research. I define scales not only as…

In this technical report, we document the development and piloting of easyCBM reading measures aligned to the Common Core State Standards, designed for use in screening students at risk for reading difficulty and monitoring their progress as they develop reading skills. The measures, which assess students' ability to respond to…

With growing concerns over higher education accountability and diminishing resources, student retention rates and the reasons why students remain at a post-secondary institution continue to persist. Since the 1960s, researchers have examined cognitive and non-cognitive factors that impact whether or not students stay at a particular post-secondary…