This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

For agencies that deliver high-stakes Second Language (L2) proficiency exams, a research agenda has been undertaken for years to examine the role of rater, task, and rubric as sources of variability into their performance assessments (Lee, 2006; Sawaki & Sinharay, 2013; Xi, 2007; Xi & Mollaun, 2006). However, these challenges are more…

The term measurement disturbance has been used to describe systematic conditions that affect a measurement process, resulting in a compromised interpretation of person or item estimates. Measurement disturbances have been discussed in relation to systematic response patterns associated with items and persons, such as start-up, plodding, boredom,…

The number of performance assessments continues to increase around the world, and it is important to explore new methods for evaluating the quality of ratings obtained from raters. This study describes an unfolding model for examining rater accuracy. Accuracy is defined as the difference between observed and expert ratings. Dichotomous accuracy…

This article addresses the problem of how to best design authentic writing assessments in history that support learners in demonstrating the types of higher order thinking skills needed for effective citizenship. Recent research has primarily focused on curriculum interventions intended to build disciplinary literacies through various types of…

Previous research in second language writing has shown that when scoring performance assessments even trained raters can exhibit significant differences in severity. When raters disagree, using discussion to try to reach a consensus is one popular form of score resolution, particularly in contexts with limited resources, as it does not require…

The aim of the current study was to gather validation evidence for the "Comprehension of Written Grammar" (CWG; Easterbrooks, 2010) receptive test of 26 grammatical structures of English print for use with children who are deaf and hard of hearing (DHH). Reliability and validity data were collected for 98 participants (49 DHH and 49…

Pre-writing stage has been considered very significant as it enhances writing performance in that learners can have discussions with the teacher and/or their peers. They can also outline and organize their ideas individually to prepare themselves for writing. This study investigated the effects of using pictures and interactions in the pre-writing…

The ability to read print to help maintain independence and quality of life is a primary concern of people with visual impairments. One option for reading is a CCTV (closed-circuit television) or, using a more specific term, electronic magnifier. An electronic magnifier uses a camera to enlarge images onto a screen. The aim of this study was to…

Using de-identified data, this study investigated the relationship between racial categories with curriculum-based early writing measures (CBM-W), which included word dictation, picture word sentence writing, and story prompt tasks for over 300 participants in Grades 1, 2, and 3. Words written, words spelled correctly, correct letter sequences,…

Every Child a Writer is a genre-based model of writing instruction promoted by the National Literacy Coalition. This paper reports on Colorado schools implementing the model. Statistical analyses of achievement patterns in implementing schools were compared to statewide achievement results. A student cohort design across multiple years was…

This study is intended to investigate student's achievement capability among two families i.e. Low and High income families and designed for primary level learners. A Reading, Arithmetic and Writing (RAW) Achievement test that was developed as a part of another research study (Tamim Ahmed Khan, 2015) was adopted for this study. Both English medium…

Planning is possibly the most important step of the assessment process. This article presents a four-tiered approach to designing and implementing a general education institutional assessment plan. Categorizing the measures you use to assess established learning outcomes helps you prioritize your general education assessment initiatives and keep…

Is there an achievement gap for online reading ability based on income inequality that is separate from the achievement gap in traditional, offline reading? This possibility was examined between students in two pseudonymous school districts: West Town (economically advantaged) and East Town (economically challenged; N = 256). Performance-based…