Intensive Home Based Treatment (IHBT) is a critical component of the continuum of community-based behavioral healthcare for youth with serious emotional disorder (SED) and their families. Yet despite being used nationwide at costs of over $100 million annually in some states, a well-vetted, research-based set of quality standards for IHBT has yet…

This study used standards setting to establish cutscores for the fidelity of implementation of an evidence-based intervention, the Self-Determined Learning Model of Instruction, designed to enhance goal-directed actions in secondary students with and without disabilities. Cutscores were then applied to a fidelity data from a large, randomized…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

One common phenomenon in Angoff standard setting is that panelists regress their ratings in toward the middle of the probability scale. This study describes two indices based on taking ratios of standard deviations that can be utilized with a scatterplot of item ratings versus expected probabilities of success to identify whether ratings are…

Purpose: In the last 5 years, many states have introduced science of reading (SOR) reforms that require increased attention to foundational skills instruction in grades K-3. The fast spread of these policies raises questions about the mechanisms that facilitated their rapid adoption. The purpose of this article is to examine how SOR discourses…

In this digital ITEMS module, Dr. Michael Bunch provides an in-depth, step-by-step look at how standard setting is done. It does not focus on any specific procedure or methodology (e.g., modified Angoff, bookmark, and body of work) but on the practical tasks that must be completed for any standard setting activity. Dr. Bunch carries the…

This study aims to demonstrate the optimal way to determine the cut-off score to be used to interpret the total scores obtained from an achievement test or scale using the Artificial Neural Networks method. To this end, the multiple-choice item responses in the Booklet-11 Mathematics subtest at the 8th grade level in the TIMSS 2015 Turkey sample…

Mealtimes in early learning settings present rich opportunities for connection, learning, and positive food experiences. Make the most of mealtimes--and prevent and address common feeding challenges--with this user-friendly planning guide, the first of its kind for early childhood educators and care providers. Written by a cross-disciplinary team…

This report provides a resource for state and district assessment staff as they develop requests for proposals (RFPs) for interim assessments for all of their students, including those who require accessibility features, to demonstrate their knowledge and skills as well as those who may need an alternate assessment because of their significant…

In this paper we assert that the practice of principled assessment design renders traditional standard-setting methodology redundant at best and contradictory at worst. We describe the rationale for, and methodological details of, Embedded Standard Setting (ESS; previously, Engineered Cut Scores. Lewis, 2016), an approach to establish performance…

In this study, the cut-off scores obtained from the Angoff, Angoff Y/N, Nedelsky and Ebel standard methods were compared with the 50 T score and the current cut-off score in various aspects. Data were collected from 448 students who took Module B1+ English Exit Exam IV and 14 experts. It was seen that while the Nedelsky method gave the lowest…

Standard-setting is an essential component of test development, supporting the meaningfulness and appropriate interpretation of test scores. However, in the high-stakes testing environment of aviation, standard-setting studies are underexplored. To address this gap, we document two stages in the standard-setting procedures for the Overseas Flight…

This chapter focuses on Education and Training 2020 (ET 2020), a significant European policy framework that provides an integrated approach to education and training. The chapter identifies the main governance mechanisms and policy instruments used by the European Union (EU) institutions within ET 2020 that lead to increased domestic policy…

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

All students confronted obstacles during the 2020 school year, but for students learning English, the year presented a distinct set of difficulties. Even as English Learner (EL) students shared in the common struggles around internet-based instruction, the tools to measure their progress in becoming proficient in English became largely unavailable…