Little research has been done on the effects of peer raters' quality characteristics on peer rating qualities. This study aims to address this gap and investigate the effects of key variables related to peer raters' qualities, including content knowledge, previous rating experience, training on rating tasks, and rating motivation. In an experiment…

In the present study, I examined the effects of rater characteristics, in particular, raters' familiarity with a foreign accent, on the assessment of second language (L2) pronunciation. Forty-three native English-speaking teachers were divided into three groups according to their reported types of familiarity with Korean accents: heritage,…

Research Findings: The purpose of this study was to refine and validate the Assessing Classroom Sociocultural Equity Scale (ACSES), an observation tool for measuring equitable sociocultural interactions in early childhood classrooms (pre-K to Grade 3) with racially minoritized learners (RMLs). Preliminary psychometric information from 142…

The aim of this study was to elaborate a scale to measure In-service Teachers' Attitudes about Inclusive Education (ITAIE). The 18-item scale was developed using a sample of 264 in-service teachers. Factor analysis indicated five categories: 1) the psychosocial competences of teachers, (2) the psycho-pedagogical advantages of the inclusive…

MOCCA-C is an assessment of adult reading ability designed for early diagnosis of reading problems, for formative assessment in reading intervention planning, for assessment of reading improvement over time, and for assessment of reading intervention outcomes. It uses both narrative and expository reading passages and it currently has four forms.…

The current study systematically investigated the effects of scoring and categorization methods on the psychometric properties of the Autism-Spectrum Quotient. Four hundred and three college students completed the Autism-Spectrum Quotient at least once. Total scores on the Autism-Spectrum Quotient had acceptable internal consistency and…

Prior work shows that children selectively learn from credible speakers. Yet little is known how they treat information from non-credible speakers. This research examined to what extent and under what conditions children may or may not learn from problematic sources. In three studies, we found that children displayed trust toward previously…

The purpose of this study was to compare the validity and reliability of three short physical activity self-report instruments to determine their potential for use with university student populations. The participants (N = 155; 44.5% male; 22.9 ± 5.13 years) wore an accelerometer for 9 consecutive days and completed a single-item measure, the a…

Despite research demonstrating the importance of language comprehension to later reading abilities, curriculum-based measures to assess language comprehension abilities in preschoolers remain lacking. The Assessment of Story Comprehension (ASC) features brief, child-relevant stories and a series of literal and inferential questions with a focus on…

Nanobiotechnology, which resulted from the convergence of biotechnology and nanotechnology, is a new field of research, and it has an increasing impact on peoples' everyday lives. Thus, it is important to measure peoples' attitudes towards nanobiotechnology, in particular, those who are specifically involved in biology and science education.…

This article discusses the use of assessment by teachers to replace external marking. It shows how professional participation and moderation can provide reliability in summative assessment, even in public examinations for older students. It draws on historical experiences of assessment for A-level English literature.

This study examined the reliability and criterion-related validity of parent ratings on the Adapted Skillstreaming Checklist (ASC) for a sample of 275 high-functioning children, ages 6-12 years, with ASD. Internal consistency for the total sample was 0.92. For two subsamples, test-retest reliability was very good at the 6-week and good at the…

Whenever multiple observers provide ratings, even of the same performance, inter-rater variation is prevalent. The resulting "idiosyncratic rater variance" is considered to be unusable error of measurement in psychometric models and is a threat to the defensibility of our assessments. Prior studies of inter-rater variation in clinical…

Consistency in statements, decisions and practices is highly important for both organization members and the image of an organization. It is expected from organizations, especially from their administrators, to "walk the talk"--in other words, to try to practise what they preach. However, in the process of gaining legitimacy and adapting…

This report provides a brief overview of how the "TOEIC"® program has adopted an argument-based approach to validity in order to support the use of the TOEIC tests. This approach emphasizes the need to explicitly state claims about the measurement quality and intended use of a test and to support those claims with evidence. This report…