Each fall the author assigns undergraduate teacher education students to design rubrics that they can use to evaluate auditions for reality television shows like "American Idol." The point is to draw students into a critical reflection on assessment literature and practices they have been studying. Through these reflections, the author…

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

How does one grade an electronic portfolio? This question is one I have thought about, have enacted, and have written about, primarily in reference to ePortfolios used in writing classrooms (Yancey, McElroy, & Powers, 2013). But what happens when the content and developmental levels are changed, in this case from an undergraduate first-year…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…

In recent years, the social sciences have seen a resurgence in the study of divergent thinking (DT) measures. However, many of these recent advances have focused on abstract, decontextualized DT tasks (e.g., list as many things as you can think of that have wheels). This study provides a new perspective by exploring the reliability and validity…

Background/Context: From two decades of research on the grading practices of teachers in secondary schools, researchers discovered that teachers evaluated students on numerous factors that do not validly assess a student's achievement level in a specific content area. These consistent findings suggested that traditional grading practices evolved…

This paper explores and presents new data on how to improve open access in distance education through using prior learning assessments. Broadly there are three types of prior learning assessment (PLAR): Type-1 for prospective students to be allowed to register for a course; Type-2 for current students to avoid duplicating work-load to gain…

The New York State Board of Regents has committed to the transformation of the preparation, support and evaluation of all teachers and school leaders in New York State, and the New York State Legislature has enacted historic legislation (Education Law §3012-c) that fundamentally changes the way teachers and principals are evaluated. Under the new…

Recently, Attali and Powers investigated the usefulness of providing immediate feedback on the correctness of answers to constructed response questions and the opportunity to revise incorrect answers. This article introduces an item response theory (IRT) model for scoring revised responses to questions when several attempts are allowed. The model…

In a study designed to analyze faculty and student perceptions of the value of digital writing in the first year composition classroom, 21 first-year college students and a nationwide sample of 50 college composition teachers participated in conceptualizing digital multimodal composition and defining the benchmarks for first-year college digital…

AIR is working with states and districts across the country to improve teacher evaluation and feedback. Our work is focused on designing systems of educator evaluation and compensation that incorporate multiple measures of performance and, in particular, measures of student growth. In this work, student learning objectives (SLOs) have emerged as a…

To rule out the need for a two-parameter item response theory (IRT) model during item analysis by Rasch models, it is important to check the Rasch model's assumption that all items have the same item discrimination. Biserial and polyserial correlation coefficients measuring the association between items and restscores are often used in an informal…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…