Although practiced widely in management education, grading of student participation in class discussions has been criticized by researchers: The instructor simultaneously adopts two incompatible tasks of facilitating class discussion and evaluating student participation; students play for points instead of focusing on learning; and common,…

The random-effects facet model that deals with local item dependence in many-facet contexts is presented. It can be viewed as a special case of the multidimensional random coefficients multinomial logit model (MRCMLM) so that the estimation procedures for the MRCMLM can be directly applied. Simulations were conducted to examine parameter recovery…

The Collegiate Learning Assessment (CLA) is a measure of how much students' critical thinking improves after attending college or university. This report illustrates how institutions can set their own standards on the CLA using a method that is appropriate for the CLA's unique characteristics. The authors examined evidence of reliability and…

The Investigators studied effects of Candidates' 10 day unit plans of instruction through prescribed action research projects, across academic years 2007-2008 and 2008-2009. Results of the spring term '07-'08 Action Research projects informed the Unit in such a way that modifications were possible and made across programs. This resulted in…

This paper describes a study comparing paper-based marking (PBM) and onscreen marking (OSM) in Hong Kong utilising English language essay scripts drawn from the live 2007 Hong Kong Certificate of Education Examination (HKCEE) Year 11 English Language Writing Paper. In the study, 30 raters from the 2007 HKCEE Writing Paper marked on paper 100…

It is possible to define an organization's culture in terms of its dominant behavioral practices and their molar consequences, from the shop floor to the executive suite (Redmon & Mason, 2001). Dysfunctional and potentially deadly practices (for the organization as a whole) can be "latent." They often go undetected until their…

In this study we use data from the Early Childhood Longitudinal Survey third- and fifth-grade samples to investigate teacher judgments of student achievement, the extent to which they offer a similar picture of student mathematics achievement compared to standardized test scores, and whether classroom assessment practices moderate the relationship…

This article examines the role of reviewer agreement in judgments about alignment between tests and standards. We used case data from three state alignment studies to explore how different approaches to incorporating reviewer agreement changes alignment conclusions. The three case studies showed varying degrees of reviewer agreement about…

The goal of the project examined here was to establish performance standards for Navy aerographer's mate (AG) enlisted sailors at three skill levels. We used an online expert judgment task and consensus workshop methodology to gather information from subject matter experts on minimal proficiency requirements for each task within each skill level.…

Context: Evolution from novice to expert is associated with the development of expert-type knowledge structure. The objectives of this study were to examine reliability and validity of concept sorting (ConSort[C]) as a measure of static knowledge structure and to determine the relationship between concepts in static knowledge structure and…

This study explored perspectives of therapist's role in care coordination between early intervention (EI) and medical services, and identified strategies for improving service delivery. Fifty adults participated in one of six focus groups. Participants included parents, pediatricians, and therapists working in hospital and EI programs. Structured…

[Slides] presented at the American Educational Research Association (AERA) Conference in New York in March 2008. This presentation explores what cues are used as a deciding factor in essay scoring by the essay grader.

In this study, the authors determine the efficacy of videoconferencing to supervise pre-service special education teachers. Efficacy is determined by (a) assessing interobserver reliability between on-site and off-site observers and (b) evaluating the feasibility and practicality of the videoconferencing technology. Data are collected in two…

Introduction: In a standards-based school-system alignment of policy documents with standards and assessment is important. To be able to evaluate whether schools and students have reached the standards, the assessment should focus on the standards. Different models and methods can be used for measuring alignment, i.e. the correspondence between…

The Classroom Observation Schedule to Measure Intentional Communication (COSMIC) was devised to provide ecologically valid outcome measures for a communication-focused intervention trial. Ninety-one children with autism spectrum disorder aged 6 years 10 months (SD 16 months) were videoed during their everyday snack, teaching and free play…