Evaluation of music performance in competitive contexts often produces discrepancies between the expert judges. These discrepancies can be reduced by using appropriate rubrics that minimise the differences between judges. The objective of this study was the design and validation of an analytical evaluation rubric, which would allow the most…

The accuracy of peer ratings on students' performance has attracted much attention from higher education researchers. In this study, we attempted to explore the accuracy of peer ratings on the quality of spoken-language interpreting in the context of tertiary-level interpreter training. We sought to understand how different types of peer raters…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

Governors and other state leaders know that the future economic competitiveness of their state depends on the strength of their education system. For years, college and career readiness (CCR) has been the mantra of many education leaders. Using education and workforce data, states went beyond "measuring" whether their high school…

The Many-Facet Rasch model is frequently used to analyse and minimize disparities in rater (judge) severity in performance evaluations, in which raters assign scores to test-takers' performances. In this research, the aim of the present study was to analyse science teacher candidates' laboratory activities by using the Many-facet Rasch model.…

Self-reports are commonly used tools for obtaining sedentary behaviors. The aim of our study was to assess agreement between two self-reports of sedentary time and a gold standard sedentary time objective monitor. A worksite sample (n = 42) completed the Slovenian version of the Global Physical Activity Questionnaire (GPAQ), the Slovenian version…

The purpose of this study was to examine the efficacy of the system of least prompts (SLP) for increasing the levels of play behaviors in four young children with disabilities. A multiple probe across participants' single case research design was used to examine the relation between SLP and child-targeted behaviors. The results demonstrated that…

The Educative Teacher Performance Assessment (edTPA) is a system of standardized portfolio assessments of teaching performance mandated for use by educator preparation programs in 18 states, and approved in 21 others, as part of initial certification for preservice teachers. Because of the high stakes involved for examinees, it is critical that…

The objective of this paper is to present the conception and validation of the Quality of Educators' Observation and Planning Practices Scale (QEOPPS). The instrument assesses the quality of early childhood educators' observation practices (observing children, collecting information, using the collected information, paying attention to each child)…

Reliability and validity are two important topics that have been studied for many decades in the educational measurement field, including discussions of Writing Studies' subfield of writing assessment, since the establishment of the College Entrance Exam Board [CEEB] in 1899 (Huot et al., 2010). In recent years, scholarly conversations of fairness…

In recent decades, the assessment of instructional quality has grown into a popular and well-funded arm of educational research. The present study contributes to this field by exploring first impressions of untrained raters as an innovative approach of assessment. We apply the thin slice procedure to obtain ratings of instructional quality along…

Assurance of learning assessment results are used as a basis for curriculum changes at Association to Advance Collegiate Schools of Business-accredited institutions. Because budget constraints and opportunity costs impact all schools, assessment quality is critical. This research uses a longitudinal, business school case study to highlight bias…

Quality of life (QoL) is a key outcome used to monitor service planning and delivery for individuals with Intellectual and Developmental Disabilities (IDD). Unfortunately, many current instruments used to measure QoL have psychometric and content limitations and none are suitable for use with individuals with the lowest levels of functioning and…

This study aims to explore the validity of measuring joint attention through gaze coordination in computer-supported collaborative learning (CSCL) research. Gaze coordination, aligning visual attention in social contexts, aids comprehension and communication. Many CSCL researchers use gaze coordination to gauge joint attention quantitatively.…

Students who hold minoritized identities are underrepresented in science, technology, engineering, and math (STEM) fields. Educational institutions often apply a deficit lens to understanding disproportionate outcomes between minoritized students and those from the cultural majority. Community Cultural Wealth (CCW) is an asset-based framework that…