In this study, I investigated the reliability of the U.S. Naturalization Test's civics component by asking 414 individuals to take a mock U.S. citizenship test comprising civics test questions. Using an incomplete block design of six forms with 16 nonoverlapping items and four anchor items on each form (the anchors connected the six subsets of…

In recent years, interest has grown in using classroom observation as a means to several ends, including teacher development, teacher evaluation, and impact evaluation of classroom-based interventions. Although education practitioners and researchers have developed numerous observational instruments for these purposes, many developers fail to…

A two-part experiment is presented that validates a new measurement tool for scoring oral reading ability. Data collected by the U.S. government in a large-scale literacy assessment of adults were analyzed by a system called VersaReader that uses automatic speech recognition and speech processing technologies to score oral reading fluency. In the…

Functional behavioral assessment (FBA) is an empirically supported intervention associated with decreasing problem behavior and increasing appropriate behavior. To date, few studies have examined multimedia approaches to FBA training. This paper provides the outcomes of a randomized controlled trial across three university sites and evaluates…

The Hoffmann reflex is obtained through surface electromyographic recordings, and it is one of the most common neurophysiological techniques in exercise science. Measurement and evaluation of the peak-to-peak amplitude of the Hoffmann reflex has been guided by the observation that it is a variable response that requires multiple trials to obtain a…

The majority of large-scale assessments develop various score scales that are either linear or nonlinear transformations of raw scores for better interpretations and uses of assessment results. The current formula for coefficient alpha (a; the commonly used reliability coefficient) only provides internal consistency reliability estimates of raw…

This study is an attempt to investigate the effect of direct and indirect feedback on the writing performance of Iranian learners of Japanese as a foreign language. During one academic semester, three indirect feedback types including underlining, coding and translation were used as well as direct type of feedback in order to see which one makes a…

This study investigates how university instructors from various disciplines at a large, comprehensive university in the United States evaluate different varieties of English from countries considered "outer circle" (OC) countries, formerly colonized countries where English has been transplanted and is now used unofficially and officially…

To assess the value of individual students' subscores on the Major Field Test in Business (MFT Business), I examined the test's internal structure with factor analysis and structural equation model methods, and analyzed the subscore reliabilities using the augmented scores method. Analyses of the internal structure suggested that the MFT Business…

The graduate experience is a critical time for development of academic faculty, but often there is little preparation for teaching during the graduate career. Teaching self-efficacy, an instructor's belief in his or her ability to teach students in a specific context, can help to predict teaching behavior and student achievement, and can be used…

Assessing silent reading fluency in classroom environments is challenging. This article reports on a method of assessing silent reading using underlining, an approach that solves many problems other silent reading fluency assessment measures face. This method computationally monitors readers' silent reading fluency by the speed they underline…

Multidimensional computer adaptive testing (MCAT) can provide higher precision and reliability or reduce test length when compared with unidimensional CAT or with the paper-and-pencil test. This study compared five item selection procedures in the MCAT framework for both domain scores and overall scores through simulation by varying the structure…

A long history of research has considered the role of iconicity in language and the existence and role of nonarbitrary properties in language and the use of language. Previous studies with Japanese-speaking children, whose language defines a large grammatical class of words with clear sound symbolism, suggest that iconicity properties in Japanese…

This study compared the effects of Tier 2 reading interventions that operated in response-to-intervention contexts. Kindergarten children (N = 90) who were identified as at risk for reading difficulties were stratified by school and randomly assigned to receive (a) Early Reading Intervention (ERI; Pearson/Scott Foresman, 2004) modified in response…

Dependent variables in research on problem behavior typically are based on measures of response repetition, but these measures may be problematic when behavior poses high risk or when its occurrence terminates a session. We examined response latency as the index of behavior during assessment. In Experiment 1, we compared response rate and latency…