Visual analysis is the primary methodology used to determine treatment effects from graphed single-case design data. Previous studies have demonstrated mixed findings related to interrater agreement between both expert and novice visual analysts, which represents a critical limitation of visual analysis and supports calls for also presenting…

When individuals engage in divergent thinking, they vary on their Elaboration, or the degree to which they explain and embellish their responses. Although Elaboration has been considered relevant to creativity research for decades, its measurement has remained under-developed. Here, we leverage technical and methodological perspectives from the…

Small-scale spatial abilities that involve the mental representation and transformation of two- and three-dimensional images and manipulation of objects at table-top have been studied extensively and are considered predictive of both interest and success in STEM disciplines. However, research investigating the relation of large-scale spatial…

This article reviews the evidence on the extent to which experts' perceptions of item difficulties, captured using comparative judgement, can predict empirical item difficulties. This evidence is drawn from existing published studies on this topic and also from statistical analysis of data held by Cambridge Assessment. Having reviewed the…

In this paper we reflect on the looming question of what constitutes expertise in ethics. Based on an empirical program that involved qualitative and quantitative as well as participatory research elements we show that expertise in research ethics and integrity is based on experience in the assessment processes. We then connect traditional…

We live in a dynamic world comprised of continuous events. Remembering our past and predicting future events, however, requires that we segment these ongoing streams of information in a consistent manner. How is this segmentation achieved? This research examines whether the boundaries adults perceive in events, such as the Olympic figure skating…

Although visual analysis has been the primary method of analysis in single-case designs (SCD), numerous statistical analyses have been developed to quantify SCD intervention effects and enable SCDs to be included in evidence-based practice reviews. This study investigated the correspondence between expert visual analysis and three effect sizes for…

Neural tuning to print develops when children learn to read and is reflected by a more pronounced left occipito-temporal negativity to orthographic stimuli as compared to non-orthographic false fonts or symbols after around 150-250 ms in their N1, a visual event-related potential (ERP). In adults, initial expertise for a novel script can emerge in…

While other fields such as statistics and education have examined various issues with quantitative work, few studies in physics education research (PER) have done so. We conducted a two-phase study to identify and to understand the extent of these issues in quantitative PER. During phase 1, we conducted a focus group of three experts in this area,…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

In many ways, evaluating informants based on their features is a problem of induction: Children rely on the assumption that observable informant characteristics (e.g., traits, behaviors, social categories) will predict unobservable characteristics (e.g., future behavior, knowledge states, intentions). Yet to make sensible inferences, children must…

The distinction between basic sciences and clinical knowledge which has led to a theoretical debate on how medical expertise is developed has implications for medical school and lifelong medical education. This longitudinal, population based observational study was conducted to test the fit of three theories--knowledge encapsulation, independent…

The purpose of this study was to describe the development of content and performance standards for a rubric to evaluate secondary-level solo instrumental music performance using a modified bookmark standard setting procedure. The research questions that guided this study include (1) What are the psychometric qualities of a rubric to evaluate…

The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…

Research objective is comparing the objective methods often used in literature for determination of differential item functioning (DIF) and the subjective method based on the opinions of the experts which are not used so often in literature. Mantel-Haenszel (MH), Logistic Regression (LR) and SIBTEST are chosen as objective methods. While the data…