This paper introduces the new Massachusetts Performance Assessment for Leaders (PAL) and uses critical policy analysis to re-examine the validity evidence (using the 2014 Standards for Educational and Psychological Testing and a theory of multicultural validity) for the use and interpretation of the PAL in regards to emerging school leadership.…

Focusing on the reflective exchanges of four test writers at an intensive language school within a public university, this study explored the effectiveness of a "lesson study" model on their professional development as test writers. Lesson study is a powerful tool for teachers' professional development and a modified version of it--a…

The 21st century has witnessed the emergence of a framework for Recognition of Prior Learning (RPL) as a supplementary assessment strategy. The aim of this study is to report on the research that explored the knowledge assessed through Mature Age Entry (MAE) admission tests in Namibian institutions of higher learning. The transformative model was…

The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

Purpose: This review evaluated whether 9 single-word tests of phonological error patterns provide adequate content coverage to accurately identify error patterns that are active in a child's speech. Method: Tests in the current study were considered to display sufficient opportunities to assess common phonological error patterns if they…

Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

This report is an update of the assessment principles and guidelines for English language learners published in 2013 (Thurlow, Liu, Ward, & Christensen). That report, which was developed by the Improving the Validity of Assessment Results for English Language Learners with Disabilities (IVARED) project, presented essential principles of…

This study is a critical analysis of a low-stakes in-house English as a Second Language (ESL) and English literacy test from a local program in a large city in the southwestern United States. From a critical multimodal social semiotic perspective (Kress G. Multimodality: A social semiotic approach to contemporary communication. Routledge, 2010;…

The purpose of this study is to describe a methodology to recover the item model used to generate multiple-choice test items with a novel graph theory approach. Beginning with the generated test items and working backward to recover the original item model provides a model-based method for validating the content used to automatically generate test…

Educators have many decisions to make and it's important that they have the right data to inform those decisions and access to questionnaires that can gather that data. This guide, developed by REL Central and based on work done through separate projects with the Wyoming Office of Public Instruction and the Nebraska Department of Education,…

This article discusses the outcomes of research into the media literacy aspects of ENEM ("Exame Nacional do Ensino Médio"), Brazil's unified university entrance exam, which contains a significant number of exam questions based on excerpts from newspaper articles, online news and other media sources. Through content analysis, these…

In the fall of 2014, the University at Buffalo created a new universal Student Evaluation of Teaching (SET). The purpose of the present study was to establish the construct validity of SET items. Rasch analyses of data from 7 semesters (N=203,194 students) revealed problems with item fit indices and threshold distances. Changes to items and…

The purpose of this study is to examine the appropriateness of using the "TOEFL Primary®" tests to evaluate the language abilities of students learning English as a foreign language (EFL) through an online-delivered curriculum, the VIPKid Major Course (MC). Data include student test scores on the TOEFL Primary Listening and Reading tests…

This paper reports on a design-based implementation study of the use of a diagnostic classroom assessment tool framed on learning trajectories (LTs) for middle grades mathematics, where teachers and students are provided immediate data on students' progress along LTs. The study answers the question: "How can one characterize the challenges…

Increased understanding of the importance of the affective domain in chemistry education research has led to the development and adaptation of instruments to measure chemistry-specific affective traits, including motivation. Many of these instruments are adapted from other fields by using the word "chemistry" in place of other…