Three studies (N = 1,346) detail the development of three theoretically grounded instruments operationalizing "instructor strictness." Using open-ended questionnaire data (n = 427), study 1 inductively derives an understanding of the instructor behaviors that students perceive as strict. These patterns of behavior are then condensed into…

Supervisors evaluated counselors-in-training at multiple points during their practicum experience using the Counseling Competencies Scale (CCS; N = 1,070). The CCS evaluations were randomly split to conduct exploratory factor analysis and confirmatory factor analysis, resulting in a 2-factor model (61.5% of the variance explained).

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

A corpus of 313 freshman college essays was analyzed in order to better understand the forms and functions of humor in academic writing. Human ratings of humor and wordplay were statistically aggregated using Factor Analysis to provide an overall "Humor" component score for each essay in the corpus. In addition, the essays were also…

The purpose of this study was to determine the reliability of a computer-based encounter card (EC) to assess medical students during an emergency medicine rotation. From April 2011 to March 2012, multiple physicians assessed an entire medical school class during their emergency medicine rotation using the CanMEDS framework. At the end of an…

This study examined the reliability and validity of the Classroom Assessment Scoring System-Secondary (CLASS-S) in Finnish classrooms. Trained observers coded classroom interactions based on video recordings of 46 Grade 6 classrooms (450 cycles). Concurrent associations were investigated with respect to teacher self-ratings (e.g., efficacy beliefs…

In the globalizing world economy, for the realization of international trade is increasing the need for foreign language learning. TR63 (Kahramanmaras, Osmaniye and Hatay) region is increasing its export every day. Besides these advances, interest is awakening in foreign language education among the region. In preparing syllabus for this kind of…

The aim of this study was to test reliabilities and validations for the Arabic translation of the Early Childhood Environment Rating Scale, Revised (ECERS-R) scale [Harms, T., Clifford, R. M., & Cryer, D. (1998). "Early childhood environment rating scale, revised edition." New York: Teachers College Press]. ECERS-R mean scores were…

The purpose of this study was to validate the measures included in the Counselor Response Observation System. The Counselor Response Observation System consists of the Counselor Response Coding System and the Skilled Verbal Responding Scale. Detailed results of their validity and reliability are presented.

Although previous studies have attempted to use different experiences of raters to rate product creativity by adopting the Consensus Assessment Method (CAT) approach, the validity of replacing CAT with another measurement tool has not been adequately tested. This study aimed to compare raters with different levels of experience (expert ves.…

The Creative Solution Diagnosis Scale (CSDS) is a 30-item scale based on a core of four criteria: Relevance & Effectiveness, Novelty, Elegance, and Genesis. The CSDS offers potential for the consensual assessment of functional product creativity. This article describes an empirical study in which non-expert judges rated a series of mousetrap…

The pervasive developmental disorders (PDDs) Autism Society Japan Rating Scale (PARS), an interview-based instrument for evaluating PDDs, has been developed in Japan with the aim of providing a method that (1) can be used to evaluate PDD symptoms and related support needs and (2) is simpler and easier than the currently used "gold…

This study is part of the core research agenda of the five-year, Goal 3 grant funded by the Institute of Education Sciences, U. S. Department of Education "Improving the Teaching and Learning of English Language Learners: The Instructional Conversation Model." In video review of teaching, bias in evaluation or rating is evident in many…

Poor language skills can have a negative effect on a developing child if not identified early. Current strategies to identify families with children who may need additional support are limited, and may not detect child language problems before they become entrenched. The present study explores observed indices of parental language as a means of…

In this study, the authors examined the validity of a holistically scored retell within a confirmatory factor analysis framework by comparing the fit of a three-factor model of reading with the data from a diverse sample of seventh and eighth graders. The final model demonstrated adequate fit, [chi][squared](32) = 97.316; comparative fit index =…