Reliability and validity are two important topics that have been studied for many decades in the educational measurement field, including discussions of Writing Studies' subfield of writing assessment, since the establishment of the College Entrance Exam Board [CEEB] in 1899 (Huot et al., 2010). In recent years, scholarly conversations of fairness…

In light of the ever-increasing capability of computer technology and advancement in speech and natural language processing techniques, automated speech scoring of constructed responses is gaining popularity in many high-stakes assessment and low-stakes educational settings. Automated scoring is a highly interdisciplinary and complex subject, and…

Over 30 states have adopted the Early Childhood Environmental Rating Scale-Revised (ECERS-R) as a component of their program quality assessment systems, but the use of ECERS-R on such a large scale has raised important questions about implementation. One of the most pressing question centers upon decisions users must make between two scoring…

The present dissertation investigated the impact of scales/scoring methods and prompt linguistic features on the measurement quality of L2 English elicited imitation (EI). Scales/scoring methods are an important feature for the validity and reliability of L2 EI test, but less is known (Yan et al., 2016). Prompt linguistic features are also known…

While significant progress has been made in recent years on technology enabled assessments (TEAs), including assessment systems that incorporate scaffolding into the assessment process, there is a dearth of research regarding psychometric scoring models that can be used to fully capture students' knowledge, skills and abilities as measured by…

The purpose of the current study was to evaluate the psychometric properties of alternative approaches to administering and scoring curriculum-based measurement for written expression. Specifically, three response durations (3, 5, and 7 minutes) and six score types (total words written, words spelled correctly, percent of words spelled correctly,…

The purpose of this study was to examine the internal structure, relationships with other variables, and diagnostic accuracy of scores on the Autism Diagnostic Observation Schedule-Generic (ADOS-G; Lord et al., 1999) for the purpose of diagnostic decision-making. Participants were 462 children enrolled in a public school district in the southern…

Writing assessments have taken two primary forms in the past two decades: direct and indirect. Irrespective of type, either form needs to be anchored to making decisions in the classroom and predicting performance on high-stakes tests, particularly in a high-stakes environment with serious consequences. In this study, 11th-grade students were…

Proof is the mathematical way of convincing oneself and others of the truth of a claim for all cases in the domain under consideration. As such, reasoning-and-proving is a crucial, formative practice for all students in kindergarten through twelfth grade, which is reflected in the Common Core State Standards in Mathematics. However, students and…

The number of young children with autism is ever-increasing, and school psychologists are more frequently required to identify these students. Valid screening tools are needed in order to focus school psychologists' time on those students in need of intensive evaluations in Early Intervention programs. The purpose of this study was to examine the…

As part of the National Science Foundation Science Literacy through Science Journalism (SciJourn) research and development initiative (http://www.scijourn.org; Polman, Saul, Newman, and Farrar, 2008) a quasi-experimental design was used to investigate what impact incorporating science journalism activities had on students' scientific literacy.…

Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by…

Classrooms are a primary site of evidence about learning. Yet classroom proceedings often occur behind closed doors and hence evidence of student learning is observable only to the classroom teacher. The informal and undocumented nature of this information means that it is rarely included in statistical models or quantifiable analyses. This…

By centralizing the issue of test fairness in language proficiency assessments, this study responds to a call by researchers for developing greater social responsibility in the language testing agenda. As inquiries into language attitude and psychology indicate, there is an underlying uncertainty pertaining to the validity of test use and score…