Objectively scoring constructed-response items on educational assessments has long been a challenge due to the use of human raters. Even well-trained raters using a rubric can inaccurately assess essays. Unfolding models measure rater's scoring accuracy by capturing the discrepancy between criterion and operational ratings by placing essays on an…

Differences in rater judgments that are systematically related to construct-irrelevant characteristics threaten the fairness of rater-mediated writing assessments. Accordingly, it is essential that researchers and practitioners examine the degree to which the psychometric quality of rater judgments is comparable across test-taker subgroups.…

Both school and district administrators use the results of standardized, large-scale tests to inform decisions about the need for, or success of, educational programs and interventions. However, test results at the school level are subject to random fluctuations due to changes in cohort, test items, and other factors outside of the school's…

Recent research has explored the use of models adapted from Mokken scale analysis as a nonparametric approach to evaluating rating quality in educational performance assessments. A potential limiting factor to the widespread use of these techniques is the requirement for complete data, as practical constraints in operational assessment systems…

We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language-Third Edition (TOWL-3; Hammill & Larsen, 1996).…

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement…

The present study investigates the relationship between L2 metalinguistic knowledge and L2 achievement among intermediate-level adult Turkish EFL learners studying at a large scale Turkish university. Metalinguistic knowledge refers to the ability to correct a grammatically incorrect structure in English and explain why it is incorrect, and…

For educational tests, it is critical to maintain consistency of score scales and to understand the sources of variation in score means over time. This practice helps to ensure that interpretations about test takers' abilities are comparable from one administration (or one form) to another. This study examines the consistency of reported scores…

The purpose of this study was to assess the effectiveness of contingency contracting on the percentage of correctly used punctuation marks in free writing tasks. Participants were three 11-year-old boys with learning disabilities (LD). A multiple-baseline across-subjects design was employed to test our prediction that the students would show…

Educational systems in Lebanon are bilingual. They simultaneously impose two handwriting systems in Arabic and Latin. This historically driven situation could constitute a significant impact on the process and development of handwriting skills. Using an accurate and valid handwriting evaluation tool standardized for the Lebanese population is a…

This research held at SMA HKBP 1 Tarutung North Sumatra on the research result of test XI[superscript 2] and XI[superscript 2] students, after they got treatment in teaching writing in recount text by using buzz group and clustering technique. The average score (X) was 67.7 and the total score buzz group the average score (X) was 77.2 and in…

The objectives of the research are to examine: (1) whether Content-Based Instruction is more effective than Problem-based learning to teach writing to the EFL Learners; (2) whether the EFL Learners having high creativity have better writing than those having low creativity; and (3) whether there is an interaction between teaching methods and EFL…

The purpose of this study was to investigate consistency in spelling skills across 2 different tasks of written production (dictation vs. composition) and stability of performance across 4 different grades. We assessed 2nd, 3rd, 4th, and 5th graders' spelling performance through 4 tasks: 2 dictation tasks (passage and sentences) and 2 composition…

This study was conducted to investigate the problem of demotivation in English language learning (ELL) within the Moroccan context. To attain this objective, two instruments were adopted: a questionnaire and a writing test. The participants involved in this study were 201 baccalaureate students (second year) from six secondary schools, 84 were…

As an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation.…