Researchers utilized a cross-sectional secondary analysis of data within an ongoing non-randomized controlled trial study design to establish the reliability and internal consistency of a novel handwriting assessment for preschoolers, the Just Write! (JW), written by the authors. Seventy-eight children from an area preschool participated in the…

The agreement between raters is examined within the scope of the concept of "inter-rater reliability". Although there are clear definitions of the concepts of agreement between raters and reliability between raters, there is no clear information about the conditions under which agreement and reliability level methods are appropriate to…

The current review examined the use of self-report measures in autistic individuals in the context of psychiatric assessments. It focused on inter-rater agreement, internal consistency, test-retest reliability, and criterion validity with clinical diagnoses. It also gathered information on constructs measured, the nature of the samples, and the…

Background: The concept of reliability is central to conducting--and understanding--research in Psychology. Students' understanding of concepts are strengthened when they learn by applying concepts. Objective: This article describes initial evidence of an activity for teaching reliability. Method: Students watched a short video of a staged bank…

Objective: Many treatment engagement challenges are documented for adolescents with ADHD. Across contexts, helping professionals (i.e., therapists, prescribers, educators, coaches) might benefit from an engagement strategy toolbox to facilitate work with adolescents with ADHD and their families. Method: The current study describes the development…

This study aims to determine the reliability of the Beck Depression Inventory (BDI), a widely used tool for diagnosing depression--a condition that significantly impacts individuals' lives--through meta-analysis, an advanced statistical technique. To achieve this objective, studies conducted in Turkey between 1961 and 2021 that utilized the Beck…

Despite the positive experiences of many candidates and the existence of many skilled examiners, the closed-door viva has been widely scrutinised on the basis of issues surrounding its reliability and quality. This study aimed to explore the views of examiners regarding this assessment method; specifically, in relation to how the issues with…

The current paper was targeted to validate the Self-Hate Scale (SHS; Turnell et al., 2019) for application within the Russian-speaking community, as it examined its validity and reliability within a sample of 302 participants. Subsequent to the translation procedures, a strong positive relationship between the English and the Russian versions was…

Background: Alexithymia is a multifaceted construct involving deficits in emotional awareness, emotional expression, and affect-oriented cognition. Although several instruments exist, concerns persist regarding construct coverage, factor instability, cultural sensitivity, and limited applicability beyond clinical settings. Objective: This study…

The pictorial scale of Perceived Movement Skill Competence assesses perceived motor competence in children. Limited validity and reliability evidence exists from the United States. The study aim was to determine indices of construct validity, concurrent validity, and internal consistency obtained from multiple versions of the Perceived Movement…

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the…

The shortage of autism specialists and lack of culturally sensitive autism assessment tools are helping to perpetuate racial and ethnic disparities in autism identification and treatment. Using DisCrit as a framework, this quantitative study examined the utility of one autism assessment tool, the Social Responsiveness Scale, second edition (SRS-2)…

Background/purpose: Generative artificial intelligence (GenAI) is often promoted as a transformative tool for assessment, yet evidence of its validity compared to human raters remains limited. This study examined whether an AI-based rater could be used interchangeably with trained faculty in scoring complex coursework. Materials/methods:…

Metacognitive awareness is essential in regulating second language (L2) listening and has been predominantly assessed by a multidimensional instrument named the Metacognitive Awareness Listening Questionnaire (MALQ). Since previous studies have yielded inconclusive evidence concerning the generalization of MALQ, it is important to examine the…

The ever-changing advances in technology require digital literacy skills for success in the workplace. To determine the critical digital literacy skills needed in the workplace today, the development of a reliable, valid instrument occurred using the nine steps of scale development by DeVellis and Thorpe (2021). Based on the SkillRise (2020a)…