Child self-regulation has been considered a valuable skill that shapes a child's future life trajectory. Parents have crucial roles in its development, making parenting interventions a strategic means to promote child self-regulation. Nonetheless, there are no available measures of child self-regulation suitable for assessing outcomes in…

This study explores the potential of OpenAI's ChatGPT-4 (gpt-4-0613) as an automated essay scoring (AES) tool in a trial involving 300 essays from an American university's academic English program placement test. Three prompting strategies (minimal/detailed rubric, require/not require rationale, and with/without scoring examples) were tested for…

This study explores the practical feasibility of Adaptive Comparative Judgment (ACJ) as a summative assessment method in legal education, focusing on a Property and Intellectual Property Law course at a Norwegian university. Eight examiners assessed 300 student responses using ACJ within traditional time constraints, performing pairwise…

The rapid shift to online learning during the COVID-19 pandemic highlighted the need to equip future educators with essential skills for an online learning environment. This study aims to address this gap by developing and validating a scale to measure pre-service teacher competency in an online learning context using the scenario method. After a…

Previous research has shown that phonological awareness is one of the most important prerequisites for early reading. Monitoring its development requires reliable, easy-to-use instruments especially in the last years of kindergarten. The present study aims to explore the potential for assessing phonological awareness and some of its subskills…

Generative AI and large language models have a significant impact on education and business, creating a pressing need for universities to act and support students in their development and understanding of these new technologies. While several emerging studies have investigated the use and perceptions of AI by students, few focus on how educators…

Supported by decades of research on praise and its effect on student behaviors, we developed the Behavior-Specific Praise--Observation Tool (BSP-OT) to measure characteristics of effective praise. We evaluated interrater reliability of the BSP-OT to measure praise specificity, contingency, and variety using intraclass correlation (ICC) and Cohen's…

Many methods are used to measure interrater reliability for studies where each target receives ratings by a different set of judges. The purpose of this study is to explore the use of hierarchical modeling for estimating interrater reliability using the intraclass correlation coefficient. This study provides a description of how the ICC can be…

Background: Objective Structured Clinical Examinations (OSCEs) are a simulation-based assessment tool used extensively in medical education for evaluating clinical competence. OSCEs are widely regarded as more valid, reliable, and valuable compared to traditional assessment measures, and are now emerging within professional psychology training…

To determine the effects of explicit instruction (EI) and potential moderators in second/foreign language (L2) teaching, this study meta-analyzed 28 primary reports (a total of 67 unique samples, N = 3754). The main results show that EI was significantly effective in facilitating L2 development, with effect sizes ranging from moderate to large…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

The Mastery Performance-Goal Orientation Test (MP-GOT) assesses performance- and mastery-orientation along a single bipolar dimension. In Study 1 (n = 198) we explored its psychometric properties and determined whether its results were related to learning. In addition, we employed Latent Profile Analysis to explore goal orientation profiles. In…

Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to…

Frailty is a health concern for many adults with intellectual disability and should be measured to detect at-risk conditions, monitor disease, plan treatment, and gauge mortality. This descriptive pilot study evaluated measurement consistency (inter-rater agreement) of the Intellectual Disability-Frailty Index Short Form among multiple assessors…

This study aims to generalize the reliability of the GAAIS, which is known to perform valid and reliable measurements, is frequently used in the literature, aims to measure one of today's popular topics, and is one of the first examples developed in the field. Within the meta-analytic reliability generalization study, moderator analyses were also…