This study compared end-of-semester student ratings from students who provided mid-semester feedback with those who did not, to measure how consistently students rated teaching effectiveness. Participants included 394 undergraduates in seven classes. Within each class, participants randomly formed the primed group, completing an online survey…

This article describes the process of development of assessment instruments for a three-year longitudinal comparative study that focused on evaluating American high school students' mathematics learning from two distinct approaches to content organization: curriculum built around a sequence of three full-year courses (Algebra 1, Geometry, and…

The oral examination is an important component of the high-stakes "O" Level examination in Singapore taken by 16-17 year olds whose first language may or may not be English. In spite of this, there has been sparse research into the examination. This paper reports findings of an exploratory study which attempted to determine whether there…

This study sought to determine the degree to which individual research consultations with a librarian can improve the work of undergraduate students. Citation analysis was used to evaluate the quality of sources selected on draft papers before meeting with a librarian and on final papers after meeting with a librarian. The rating scale presented…

This comparative case study investigated the educational software evaluation processes of both experts and novices in conjunction with a software evaluation checklist. Twenty novice elementary education students, divided into groups of five, and three experts participated. Each novice group and the three experts evaluated educational software…

Current literature provides many examples of rubrics that are used to evaluate the quality of web-quest designs. However, reliability of these rubrics has not yet been researched. This is the first study to fully characterize and assess the reliability of a webquest evaluation rubric. The ZUNAL rubric was created to utilize the strengths of the…

Competency-based assessment and an emphasis on obtaining higher-level outcomes that reflect physicians' ability to demonstrate their skills has created a need for more advanced assessment practices. Simulation-based assessments provide medical education planners with tools to better evaluate the 6 Accreditation Council for Graduate Medical…

Most inter-rater reliability studies using nominal scales suggest the existence of two populations of inference: the population of subjects (collection of objects or persons to be rated) and that of raters. Consequently, the sampling variance of the inter-rater reliability coefficient can be seen as a result of the combined effect of the sampling…

A persistent conflict between assessment professionals and faculty members in the humanities seems to focus inevitably on resistance to the concept of interrater reliability. While humanities faculty are often willing to engage in course-embedded assessment that uses some type of scoring rubric, when the demand for agreement in scoring is…

Goal attainment scaling (GAS) has been considered to be one of the most versatile and appealing evaluation protocols available for human services. Aspects of the protocol that make the method so appealing to practitioners--that is, collaboratively working with individual clients to identify and assign weights to goals they will work to…

The three algorithms most frequently selected by behavior-analytic researchers to compute interobserver agreement with continuous recording were used to assess the accuracy of data recorded from video samples on handheld computers by 12 observers. Rate and duration of responding were recorded for three samples each. Data files were compared with…

The paper describes a multicentre study of the psychometric properties of the Manchester Child Attachment Story Task in a sample of 230 Italian children aged 4 to 8 years. The task's internal consistency and inter-rater reliability were investigated; in addition, multiple discriminant analysis was used to explore the contribution of individual…

We investigate experienced high school geometry teachers' perspectives on "authentic mathematics" and the much-criticized two-column proof form. A videotaped episode was shown to 26 teachers gathered in five focus groups. In the episode, a teacher allows a student doing a proof to assume a statement is true without immediately justifying it,…

Collaborative Strategic Reading (CSR) is a set of instructional strategies designed to improve the reading comprehension of students with diverse abilities (Klingner and Vaughn 1996). Teachers implement CSR at the classroom level using scaffolded instruction to guide students in the independent use of four comprehension strategies; students apply…

The authors examined, by direct observation and 1 hr interval self-reporting, teacher time use in 4 types of special education programs (adaptive behavior units, content mastery, coteaching, resource room). Over 7,000 pieces of data were collected across an academic year from 31 teachers in 24 schools within 9 districts in the Southwestern United…