An ePortfolio Assessment Institute (AI) structured as a faculty development opportunity was undertaken to increase faculty confidence in teaching and assessing ePortfolios and to collect reliable data about student performance on four learning outcomes associated with an institutionwide ePortfolio initiative. Faculty raters participated in the…

Objective: There is a difference between interventions as planned and as delivered in practice. Unless we know what was actually delivered, we cannot understand "what worked" in effective interventions. This study aimed to (a) assess whether an established taxonomy of 53 smoking cessation behavior change techniques (BCTs) may be applied…

Over time, criticisms related to the technical rigor of informal reading inventories (IRIs) have led many to question using these assessment instruments for high- or low-stakes purposes. In this article, I examine reliability evidence reported in 11 new and updated IRIs and make comparisons with Spector's earlier analysis that revealed fewer than…

Research Findings: The present study provides an initial descriptive comparison of the Early Childhood Environment Rating Scale-Revised (ECERS-R) and the Early Childhood Environment Rating Scale-Third Edition (ECERS-3) in a relatively large sample in 1 state that uses the Environment Rating Scales within its Quality Rating and Improvement System…

Children with hearing impairment (HI) are at an increased risk of developing speech and language problems similar to those of children with developmental language disorder (DLD), including difficulties with phonology and grammar. This study investigated similarities and differences in phonological and grammatical production between children with…

Research on the age of learning effect on second language learners' foreign accents utilizes human judgments to determine speech production outcomes. Inferences drawn from analyses of these ratings are then used to inform theories. The present study focuses on rater differences in the age of learning effect research. Three groups of raters who…

Recent findings in creativity research suggest that how creativity is operationalized may have a profound influence on theories of creative production. In this study, two paradigms--divergent thinking and creative problem solving--were compared on several indices of creativity while keeping the problem constant. Participants were students from a…

The aim of this study was to provide psychometric evidence related to the "Behavioral and Emotional Screening System Teacher Rating Scale-Preschool" form's (BESS TRS-P) ability to identify emerging problems in preschool children. Reliability and validity associated with screener scores were compared by analyzing teacher ratings of…

This study sought to validate a new measure, the Classroom Cohesion Survey (CCS), designed to examine the relationship between teachers and classroom assistants in autism support classrooms. Teachers, classroom assistants, and external observers showed good inter-rater agreement on the CCS and good internal consistency for all scales. Simple…

Concepts from the Response-to-Intervention (RTI) Model were used to promote a successful course outcome for students at risk for making low grades in an entry-level college course. The first exam served as a universal screener to identify students who could potentially benefit from RTI assistance. The researchers developed a tiered coaching…

We examine the factor structure of scores from the CLASS-S protocol obtained from observations of middle school classroom teaching. Factor analysis has been used to support both interpretations of scores from classroom observation protocols, like CLASS-S, and the theories about teaching that underlie them. However, classroom observations contain…

The inter-rater reliability of university students' evaluations of teaching quality was examined with cross-classified multilevel models. Students (N = 480) evaluated lectures and seminars over three years with a standardised evaluation questionnaire, yielding 4224 data points. The total variance of these student evaluations was separated into the…

Who is the most preferred and deemed the most helpful reviewer in improving student writing? This study exercised a blended teaching method which consists of three currently prevailing reviewers: the automated grading system (AGS, a web-based method), the peer review (a process-oriented approach), and the teacher grading technique (the…

Pop lyrics represent a rich, but underused resource in language teaching in both institutional and informal contexts. This is striking in view of analyses from the fields of motivational and cognitive psychology, didactics as well as linguistics, which all provide evidence for the inherent potential of pop lyrics. This paper will first take a…

Purpose: The Expository Scoring Scheme (ESS) is designed to analyze the macrostructure of descriptions of a favorite game or sport. This pilot study examined inter- and intrarater reliability of the ESS and use of the scale to capture developmental change in elementary school children. Method: Twenty-four children in 2 language groups (monolingual…