This article proposes a Boolean approach to representing and analyzing interobserver agreement in dichotomous coding. Building on the notion that observations are samples of a universe of observations, it submits that coding can be viewed as a process in which observers sample pieces of evidence on constructs. It distinguishes between formal and…

The COVID-19 pandemic highlighted the critical need for enhanced outbreak preparedness against viruses. Key elements to this preparedness are robust disease surveillance systems and effective interventions to minimize disease transmission. While individual clinical testing is the conventional disease surveillance approach, environmental…

Purpose: In the early 1980s, researchers and speech-language pathologists (SLPs) collaborated to develop the Systematic Analysis of Language Transcripts (SALT). Research and development over the ensuing decades has culminated into SALT Solutions, a set of tools to assist SLPs to efficiently complete language sample analysis (LSA) with their…

Forensic science practitioners compare visual evidence samples (e.g. fingerprints) and decide if they originate from the same person or different people (i.e. fingerprint 'matching'). These tasks are perceptually and cognitively complex--even practising professionals can make errors--and what limited research exists suggests that existing…

This study examined caregivers' longitudinal reports of adolescent multiracial categorization across the ages of 9.5, 10.5, and 14 years, and adolescents' reports of their own multiracial categorization at the age of 14 years. A portion of caregivers' reports of adolescent multiracial status were inconsistent across the years of the study; some…

Colleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models. We address this lack of transparency by systematically comparing two…

Background: To advance early identification efforts, we must detect and characterize neurodevelopmental sequelae of risk among population-based samples early in development. However, variability across the typical-to-atypical continuum and heterogeneity within and across early emerging psychiatric/neurodevelopmental disorders represent fundamental…

The most widely used formal approach to culture, the cultural consensus theory (CCT) of Romney, Weller, and Batchelder, originally relied on a priori definitions of cultural groups to map their unity and diversity. Retaining key features of classical CCT, we provide techniques to identify two or more cultural subgroups in a sample, whether those…

Events such as curriculum changes or practice effects can lead to item parameter drift (IPD) in computer adaptive testing (CAT). The current investigation introduced a point- and weight-adjusted D[superscript 2] method for IPD detection for use in a CAT environment when items are suspected of drifting across test administrations. Type I error and…

In psychological and survey research, the prevalence and serious consequences of careless responses from unmotivated participants are well known. In this study, we propose to iteratively detect careless responders and cleanse the data by removing their responses. The careless responders are detected using person-fit statistics. In two simulation…

Since 2003, the Programme for International Student Assessment (PISA) has included students with special educational needs (SEN), identified as those with functional disabilities, those with cognitive/behavioural/emotional disabilities and those with limited test language proficiency. While the number of countries and included students has…

Purpose: Computer simulation was used to estimate the statistical properties of searches for maximum word recognition ability (PB max). These involve presenting multiple lists and discarding all scores but that of the 1 list that produced the highest score. The simulations, which model limitations inherent in the precision of word recognition…

One interesting idea in social network analysis is the directionality test that utilizes the directions of social ties to help identify peer effects. The null hypothesis of the test is that if contextual factors are the only force that affects peer outcomes, the estimated peer effects should not differ, if the directions of social ties are…

This paper provides an overview of the design and cohort characteristics of the Social Spectrum Study: a clinical cohort study that used a two-phase sampling design to identify children at risk for ASD. After screening 1281 children aged 2.5-10 years who had been consecutively referred to one of six mental health services in the Netherlands,…

The omega (?) statistic is reputed to be one of the best indices for detecting answer copying on multiple choice tests, but its performance relies on the accurate estimation of copier ability, which is challenging because responses from the copiers may have been contaminated. We propose an algorithm that aims to identify and delete the suspected…