When constructing measurement scales, regular and reversed items are often used (e.g., "I am satisfied with my job"/"I am not satisfied with my job"). Some methodologists recommend excluding reversed items because they are more difficult to understand and therefore engender a second, artificial factor distinct from the…

Cognitive load studies are mostly centered on information on perceived cognitive load. Single-item subjective rating scales are the dominant measurement practice to investigate overall cognitive load. Usually, either invested mental effort or perceived task difficulty is used as an overall cognitive load measure. However, the extent to which the…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

The efficiency of cognitive component skills is typically assessed with speeded performance tests. Interpreting only effective ability or effective speed as efficiency may be challenging because of the within-person dependency between both variables (speed-ability tradeoff, SAT). The present study measures efficiency as effective ability…

This study employed a multi-methods design to investigate the impact of preparation on Chinese test-takers' perceptions of the integrated TOEFL iBT speaking and writing design. Combining results from over 1700 surveys and 10 interviews, it was found that these Chinese test-takers, who are the most vulnerable group in the multimillion testing…

The purpose of this study was to construct a higher-order thinking test of science for pre-service elementary school teachers. The test was created using the ADDIE model. The analysis stage was carried out by identifying the needs and baseline of higher-order thinking skills of students from the department of primary School Teacher education in…

Researchers design diagnostic assessments to measure students' knowledge structures and processing skills to provide information about their cognitive attribute. The purpose of this study is to determine the instrument's validity and score reliability, as well as to investigate the use of classical test theory to identify item characteristics. The…

Since the development of the technological pedagogical content knowledge (TPACK) framework, researchers have been developing a variety of instruments to measure the TPACK of pre-service and in-service teachers. The task of developing an efficient, reliable, and valid instrument is difficult. Even validated instruments require guidance for…

This study aims to investigate: (1) the construct validity of the "Blended Learners' Online Component Challenges" BLOCC scale; (2) the internal reliability of the scale; and (3) the differences between blended learners' online component challenges according to different socio-demographic variables for Sport Science students. The sample…

e-Textbooks and e-learning technologies have become ubiquitous in college and university courses as faculty seek out ways to provide more engaging, flexible and customizable learning opportunities for students. However, the same technologies that support learning can serve as a source of frustration. Research on frustration with technology is…

In the current study, we aimed to develop a reliable and valid scale to address individual cognitive load types. Existing scale development studies involved limited number of items without adequate convergent, discriminant and criterion validity checks. Through a multistep correlational study, we proposed a three-factor scale with 13 items to…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students' performance on…