When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the…

This study aims to adapt to Turkish the "Scale for the assessment of non-experts: AI literacy" developed by Laupichler et al. (2023a). The scale consists of 31 items with three sub-dimensions: technical understanding, critical thinking, and practical applications. The data required for the validity and reliability study of the scale were…

Although the original long version of the Hewitt Multidimensional Perfectionism Scale (HMPS) has been translated and validated in a Spanish population, no study to date has examined the psychometric properties of a short version of the HMPS with a Spanish-speaking sample. For this reason, the aim of this study is to analyze the psychometric…

The present study evaluated the validity of the Online Learner Satisfaction Instrument (OLSI) in terms of construct and convergent validity, and measurement invariance across demographic groups. The study results revealed that the factor structures generally confirmed to the original factor structure proposed in the instrument. Also, some…

We developed the Counsellor Personal Wellness and Professional Wellbeing (CPW) assessment based on the integration of the Well-Being theory and the Indivisible Self Model of Wellness (IS-WEL). Our participants included 326 counsellors, counsellor educators, and counsellors-in-training in the United States. The participants primarily identified as…

This article presents the development, results, validation, and implications of the TRansformative Outcomes and PrOcesses Scale (TROPOS), a 30-item, exploratory instrument to assess transformative learning (TL) among participants in educational programs. Core findings include a reliable ([alpha] = 0.884) and internally valid instrument with…

To ensure the validity of an assessment programme, it is essential to align it with the intended learning outcomes (LO). We present a model for ensuring assessment validity which supports this constructive alignment and uses learning analytics (LA). The model is based on LA that include a comparison between ideal LO weights (expressing the…

The National Matriculation English Test (NMET), also known as the Gaokao English Examination, is a high-stakes, large-scale selection test for tertiary education in China, with numerous provinces and regions adopting the standardized national test papers. The validity of the NMET has garnered extensive attention. To verify the NMET's validity, it…

Sense of belonging among students has been studied extensively (Gopalan & Brady, 2020), and has been shown to be a predictor of success, engagement, and well-being in college students. While studies have investigated a sense of belonging amongst specific marginalized groups within a university (e.g. Duran et al., 2020; Lewis et al., 2021; Sims…

This study presents a new instrument for assessing reflective thinking, self-efficacy, and self-regulated learning (SRL) among Universitas Terbuka postgraduate students registered in an online Research Methods course. The study validates the instrument's dependability (Cronbach's alpha = 0.918) and builds a strong factor structure by means of…

Graduate teaching assistants (TAs) may identify with multiple roles during their introductory biology teaching experiences. This study developed an instrument that measures TA role identity in introductory biology. Initial development and content validation of the Biology Teaching Assistant Role Identity Questionnaire (BTARIQ) occurred in four…

Purpose: This paper aims to measure the extent to which students possess the necessary competences of an employable graduate, the authors explored the development and validation of a questionnaire that measures employability competences of students in higher education through combining insights from higher education and workplace learning…

The impact of the social determinants of health (SDH) on health outcomes is receiving increased attention. Health profession students need to learn about SDH; however, there are no validated tools to measure student competence in assessing SDH. There is a need for a brief, valid instrument to measure student competency and knowledge of SDH. This…

We evaluated the validity of using the GRE General Test to assist with graduate school admissions for individuals with disabilities. We studied a sample of 16,239 graduate students from 10 U.S. research universities in three groups: students without any reported disabilities, students who reported disabilities and took the computer-delivered GRE…

This study is an investigation of the validity of the Online Test Anxiety Inventory (O?-TAI) for adult students. The scale contained the 20 items of the Test Anxiety Inventory (Spielberger, 1980), together with five computer anxiety items, all rephrased so as to pertain to online test anxiety. The scale was administered to a large sample of Greek…