The purpose of this study was originally to create an operational definition of the "appearance of competence" to design valid questions for educational professionals supporting twice-exceptional (2e) learners to create a testing instrument. Through the methodological process of grounded theory, a replacement research question emerged as…

Question generation (QG) task plays a crucial role in adaptive learning. While significant QG performance advancements are reported, the existing QG studies are still far from practical usage. One point that needs strengthening is to consider the generation of question group, which remains untouched. For forming a question group, intrafactors…

Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for…

Short scales are time-efficient for participants and cost-effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low-quality items is greater on…

Combining methods from earlier content validity and more contemporary content alignment studies may allow a more complete evaluation of the meaning of test scores than if either set of methods is used on its own. This article distinguishes item relevance indices in the content validity literature from test representativeness indices in the…

Exams can be a stressful time in a student's life where they are required to review notes and memorize facts and figures. Many students leave these exams and forget the material relatively quickly. An alternative pedagogical exam style where students create their own exam questions is a method that engages students through active participation and…

Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated…

Employment, social relationships, and autonomy are priorities to people with intellectual and developmental disabilities (IDDs). However, few validated measures exist to systematically assess these key adult outcomes in this population. This research includes first steps to develop self- and proxy report measures of life outcomes for adults with…

This study investigates the effect of survey order in measuring self-reported cognitive load. Understanding how survey order influences responses is crucial, but it has been largely overlooked in the context of cognitive load. Using a 2 × 2 experimental design with 319 high school students, the study manipulated intrinsic cognitive load (ICL)…

The number of complaints university lecturers make about a lack of knowledge, especially first-year students' procedural knowledge, has increased recently. Due to missing adequate empirical evidence, a survey of procedural knowledge among students of Austrian high schools in their final year was conducted. For this purpose, test items for…

This study aims to adapt the Motor Competence Assessment (MCA) instrument for autistic children. The adaptation was carried out in three stages: (a) a pilot test, (b) MCA assessment of 45 children with autism (Levels I and II) aged 5-11 years with documentation of each MCA test difficulties, and (c) adaptations to the original MCA tests were…

Stress is a complex construct that is related to resilience and general health starting in childhood. Despite its importance for student health and well-being, there are few measures of stress designed for school-based applications. In this study, we developed and initially validated a Stress Indicators Scale using five samples of teachers,…

ChatGPT, an artificial intelligence powered chat tool that accomplishes essential work with its language understanding and text generation capabilities, has started to benefit education and many other areas with new updates. This study predicted the ability to create a number sense achievement test with ChatGPT version 3.5. It showed that the test…

The study aimed to develop and validate a tool that assessed students' foundational movement skills, for primary school teachers. The playground circuit, including 14 movement skills (e.g. functional, locomotor and object control), was developed through insights and recommendations from teachers (n = 36) and academic experts (n = 25). To validate…

Developing an assessment tool to identify mathematical misconceptions is important for early intervention and support for at-risk students. This exploratory sequential mixed methods study aimed to develop and validate a questionnaire for self-reflection on mathematical misconceptions among senior high school students using exploratory and…