About 45 R packages to analyze data using item response theory (IRT) have been developed over the last decade. This article introduces these 45 R packages with their descriptions and features. It also describes possible advanced IRT models using R packages, as well as dichotomous and polytomous IRT models, and R packages that contain applications…

Meta-analytic reliability generalizations (RGs) are limited by the scarcity of reliability reporting in primary articles, and currently, RG investigators lack a method to quantify the impact of such nonreporting. This article introduces a stepwise procedure to address this challenge. First, the authors introduce a formula that allows researchers…

The study, with 79 rehabilitation therapists evaluating 21 single-subject graphs, found that the low interrater agreement often associated with visual analysis of single-subject data may be improved by simple supplements (such as trend lines) to visually inspected charts. (Author/DB)

The Correct Information Unity analysis for measuring the communicative information and efficiency of connected speech was applied to the naturally occurring conversation of a person with moderate aphasia. Results indicated low intrarater and interrater reliability although reliability of word counts was good. Most rater disagreements resulted from…

The purpose of this paper is to discuss ways in which developmental psychology suffers from the lack of an appropriate technology of measurement and statistical analysis. The paper begins by noting that developmental psychology is the study of change; that individuals develop through a succession of "stages" which are separated by…

Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

CSCL research has given rise to a plethora of analysis methods, all with specific analysis goals, units of analysis, and for specific types of data (chat, threaded discussions, etc.). This article describes some challenges of CSCL-analysis. The development of an analysis method for negotiation processes in multidisciplinary teams serves as an…

This study of the stability of parent behaviors toward toddlers over a 3-week period used both aggregated and nonaggregated data. Comparison of stability correlations indicated higher stabilities for aggregated scores, with the level of stability increasing as scores from additional single sessions were aggregated. (PCB)

Narrative data yield rich detail, insight, and information, but the personal and situational characteristics of coders (called value inertia and cognitive limitation biases) can affect data reduction. The effects of coder exposure to expected project outcomes and the level of coder research methodology sophistication were investigated. Coders,…

Because of the importance of single-subject studies in mental retardation research, a meta-analysis of the literature examining interrater agreement for visual analysis of single-subject data was conducted. Analysis revealed an overall itinerant agreement value of 0.58 for 14 studies representing 789 raters. Effects of data type, design type,…

Because health behavior is often concerned with dynamic constructs, a longitudinal approach to measurement is needed. The Longitudinal Guttman Simplex (LGS) is a measurement model developed especially for dynamic constructs exhibiting cumulative, unitary development measured longitudinally. Data from the Television Smoking Prevention Project, a…

The focus of this study was on the visual analysis of time series data for evaluating educational programs. Two characteristics of the data--changes in slope and variability--and two characteristics of evaluation--training in data utilization and the use of aimlines/decision rules--were manipulated. A total of 51 students and/or teachers in…

The study of teachers as decision-makers is a recent paradigm in educational research. This decision-making approach considers the teacher as an active professional engaged in various decision-making activities prior to and during instruction. This paper describes a naturalistic research design employed in a recent dissertation that investigated…

This document investigates the widely used school climate assessment instrument, the CFK Ltd. School Climate Profile. Part A (General School Climate Factors) was administered by school to a junior high campus (n=257) and a high school campus (n=906) in a major metropolitan area in the Southwestern United States to gather data for administrative…

Addresses applications of the coefficient of variation as a measure of educational inequality or as a means of measuring changes of inequality status. Suggests the Gini coefficient has many advantages over the coefficient of variation since it can be used with the Lorenz curve (Lorenz provides detail Gini omits). (BRR)