We examine the origin and evolution of male-female rating gaps for young chess players using two decades of data from the U.S. Chess Federation, the national chess association that tracks competitive tournament play and provides ratings for U.S. chess players. An important feature of our research is that we examine male-female gaps across a broad…

Low target prevalence affects perceptual decisions on both simple and complex stimuli. Without prior knowledge of how often targets may appear, trial-by-trial accuracy feedback modulates the effects of low prevalence partially by providing observers with information about the target base rate. Using simple colored dots, Lyu (PBR 28:1906-1914,…

Based on the assumptions of cognitive load theory, this study aims to utilize the eye movement data collected from multiple experts to scaffold novice graphic designers. The study has two main stages. In the first stage, eye tracking was used to record the eye movements of 7 experts, who covered eight topics explaining how to use Photoshop. The…

Public speaking classes should ideally produce students whose speeches are favorably received by an audience. Unfortunately, we actually know very little about how non-expert audiences assess such speeches. Given this information gap, the present study asked untrained public speakers to watch and rate a variety of speeches. Participants were also…

Visual analysis is the primary methodology used to determine treatment effects from graphed single-case design data. Previous studies have demonstrated mixed findings related to interrater agreement between both expert and novice visual analysts, which represents a critical limitation of visual analysis and supports calls for also presenting…

Bringing Edward Said's intellectual work into education comes with a certain irony. As early as his magnum opus, "Orientalism," Said already questioned the social function of intellectuals as experts, arguing that the project of orientalism could not have transpired without the 'expert' eyes of intellectuals who distorted the Orient…

Teacher noticing--i.e., attending to and interpreting--students' mathematical thinking is a predominant framework in preparation programs for pre-service mathematics teachers, based on the assumption that they should learn to notice early in their training to acquire the expertise needed in their professional lives. Most research on this topic…

Spontaneous judgment and decision-making (JDM) are common behaviors that remain ambiguous to be utilized in architecture design studios. A decision-maker (DM) response varies due to individual differences in an architectural design (AD) environment that keeps changing from abstract ideas to concrete design details along the process. The study aims…

Anxiety is a multifaceted force that can negatively impact the ability of evaluators to succeed in practice. In the evaluation literature, discussions concerning anxiety have primarily been limited to strategies to reduce stakeholder anxiety to encourage positive and productive working relationships with evaluators. This study was among the first…

People can fail to notice objects and events in their visual environment when their attention is engaged elsewhere. This phenomenon is known as inattentional blindness, and its consequences can be costly for important real-world decisions. However, not noticing certain visual information could also signal expertise in a domain. In this study, we…

Learning programming has become increasingly popular, with learners from diverse backgrounds and experiences requiring different support. Programming-process analysis helps to identify solver types and needs for assistance. The study examined students' behavior patterns in programming among beginners and non-beginners to identify solver types,…

This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…

This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…

This paper introduces a framework of two key shifts--epistemological and authority--to conceptualise the challenges mathematics teachers face when moving from classroom teaching to professional development (PD) facilitation. I argue that while teaching and facilitation may appear similar, critical differences in how knowledge is constructed and…

The consensus-based assessment has long been a prevalent methodology employed in "panel crit" settings in design education and professional design awards. Acknowledging the subjective nature of design evaluation and its importance to the design development process, we report two studies investigating the effect of three levels of design…