Assessment and evaluation are at the heart of all functioning systems, as progress can be determined with the information collected by these assessments. The problem addressed in this study is the lack of actionable data to evaluate whether assessments aligned with Montessori benchmarks support the achievement of student outcomes. To address the…

Governors and other state leaders know that the future economic competitiveness of their state depends on the strength of their education system. For years, college and career readiness (CCR) has been the mantra of many education leaders. Using education and workforce data, states went beyond "measuring" whether their high school…

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

Ratings published by the National Council on Teacher Quality (NCTQ) require selectivity in admission to educator preparation programs. NCTQ provides a list of citations to support the selectivity standard termed "strong support." A review of each citation in the list found little or no support for the standard. Original data was…

An online Moodle Workshop was evaluated for peer assessment effectiveness. A quasiexperiment was designed using a Seminar in Professionalism course taught in face-to-face mode to undergraduate students across two campuses. The first goal was to determine if Moodle Workshop awarded a fair peer grader grade. The second objective was to estimate if…

The design, delivery and assessment of a complete educational scheme, such as a degree programme or a professional qualification course, is a complex matter. Maintaining alignment between the stated aims of the curriculum and the scoring of student achievement is an overarching concern. The potential for drift across individual aspects of an…

No Child left Behind, The ESEA Flexibility Program, and the Race to the Top contest have spurred a multitude of School Improvement programs, businesses, initiatives and more. The current emphasis on standardized testing, data gathering and analysis, and measuring effective schooling has caused many education agencies, state and local, to seek…

Education leaders and much literature exhort teachers and school leaders to use data more often and more effectively to guide planning and decision making--called, "data driven decision making." This term is ubiquitous in literature and reform discourse, but "on the ground," so to speak, practitioners face significant challenges in analyzing,…

The purpose of this study was to examine the alignment of the easyCBM[R] mathematics benchmark and progress monitoring measures to the National Council of Teachers of Mathematics "Curriculum Focal Points" (NCTM, 2006). Based on Webb's alignment model (1997, 2002), we collected expert judgments on individual math items across a sampling of forms…

"Voice" is widely considered to be a feature of effective writing. It's no surprise, then, that voice criteria frequently appear on rubrics used to score student essays in large-scale writing assessments. However, composition theorists hold vastly different views regarding voice and how it should be applied in the evaluation of student writing, if…

The purposes of this study were to investigate the role of benchmark writing samples in direct assessment of writing and to examine the consequences of differential benchmark selection with a common writing rubric. The influences of discourse and grade level were also examined within the context of differential benchmark selection. Raters scored…

The use of online rater self-training is growing in popularity and has obvious practical benefits, facilitating access to training materials and rating samples and allowing raters to reorient themselves to the rating scale and self monitor their behaviour at their own convenience. However there has thus far been little research into rater…

To generalize test results beyond the particular test administration, an examinee's ability estimate must be independent of the particular items attempted, and the item difficulty calibrations must be independent of the particular sample of people attempting the items. This stability is a key concept of the Rasch model, a latent trait model of…

Current educational policy highlights the important role that assessment can play in improving education. State standards and the assessments that are aligned with them establish targets for learning and promote school accountability for helping all students succeed; at the same time, feedback from assessment results is expected to provide …

The purpose of this study was to take an initial step toward developing sound and versatile predictive instruments (i.e., benchmark measures) in reading, writing, and math that can be used to assess high-school students' academic performance in a manner that will not only predict scores on high-stakes tests but will also be amenable to repeat…