Considerable research has been devoted to exploring aspects of higher-order thinking across various disciplines and in daily life. However, insufficient attention has been paid to synthesizing core dimensions of higher-order thinking, particularly within subject-specific contexts. Moreover, there is a lack of reliable and valid methods for…

Purpose: Using a longitudinal design, the present study evaluated the utility of the picture sequences in the Multilingual Assessment Instrument for Narratives (MAIN) for assessing Mandarin-speaking children's narrative skills from kindergarten through Grade 2 in Taiwan. Method: Participants were 27 children with typical language (TL) and 22 with…

This paper describes the adaptation and validation of a brief Big Five Inventory for upper elementary school children in China. Two independent samples, comprising 1884 and 2245 children from Grade 4 to Grade 6, were used to pilot and cross-validate the adapted questionnaire. We first explored the underlying factor structure and composite…

Engineering identity is a developing construct within the field of engineering that has been found to be a strong predictor of engineering persistence, retention, and success. While the theoretical definitions and operationalizations of the construct have matured, instruments used to measure engineering identity lack in one vital component -- they…

The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on…

Previous studies have found that pride is a frequent and important emotion in achievement contexts although it is under-researched in the second/foreign language (FL) context. Therefore, the aim of this research was to explore pride in the context of FL learning. For this purpose, we proposed a conceptual model of FL pride, drawing on previous…

Social support is essential to doctoral students' success. However, there is a lack of available instruments that tap into the different sources of social support among doctoral students. To fill the gap, this research developed and validated the Perceived Social Support Scale-Doctoral Students (PSSS-DS). An initial item pool of 42 items was…

The validity of the screening tools used as a part of assigning students to tiers within the Three Tier framework is essential for its quality and success. Although the Three Tier model has been widely implemented, there remains a lack of comprehensive synthesis regarding the accuracy of screening methods used as part of tier assignment…

Assessment literacy is an essential competency area for professional counselors who administer tests and interpret the results of participants' scores. Using factor analysis to demonstrate internal structure validity of test scores is a key element of assessment literacy. The underuse of psychometrically sound instrumentation in professional…

This study provides a solid validity inferential network to guide the development, interpretation, and use of machine learning-based next-generation science assessments (NGSAs). Given that machine learning (ML) has been broadly implemented in the automatic scoring of constructed responses, essays, simulations, educational games, and…

Supervision is an important component of counselor development; however, limited research exists on evaluating supervision. There is also a lack of comprehensive, psychometrically strong assessments to measure supervision competencies. In this study we focused on the development of the Supervision Competencies Scale (SCS), an assessment designed…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

There is a need for more knowledge of valid and standardized measures of mental health problems among children and adolescents with intellectual disability (ID). In this study, we systematically reviewed and evaluated the psychometric properties of instruments used to assess general mental health problems in this population. Following PRISMA…

Special education teachers' (SETs) working conditions play a crucial role in shaping the size, quality, and effectiveness of the U.S. SET workforce and thereby shape the quality of instruction provided to students with disabilities. Valid measures of SETs' working conditions are essential for conducting robust research on how to improve working…

Understanding the cognitive processes, skills and strategies that examinees use in testing is important for construct validity and score interpretability. Although response processes evidence has long been included as an important aspect of validity (i.e., "Standards for Educational and Psychological Tests," 1999), relevant studies are…