Symmetry considerations are important in science, and Group Theory is a theory of symmetry. Classical Measurement Theory is the most used measurement theory in the social and behavioral sciences. In this article, the author uses Matrix Lie (Lee) group theory to formulate a measurement model. Symmetry is defined and illustrated using symmetries of…

Users of forced-choice questionnaires (FCQs) to measure personality commonly assume statement parameter invariance across contexts -- between Likert and forced-choice (FC) items and between different FC items that share a common statement. In this paper, an empirical study was designed to check these two assumptions for an FCQ assessment measuring…

We present an audience reception study of participant reactions to gender-based violence in Issa López' 2008 film, "Casi Divas," chosen for its nuanced depiction of women grappling with several violences. Over three focus groups with 15 adult participants, we used Galtung's conflict theory to explore what participants identified as…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

The risk of multitasking is high in online surveys. However, knowledge on the effects of multitasking on answer quality is sparse and based on suboptimal approaches. Research reports inconclusive results concerning the consequences of multitasking on task performance. However, studies suggest that especially sequential-multitasking activities are…

In this crossover experiment, we investigated the impact of a statement bank, enabling the reuse of previously written feedback (SA condition), on 45 math teachers' feedback for 60 completed linear equation tests, compared to traditional pen-and-paper feedback (PP condition). In the SA condition, teachers were encouraged to use atomic feedback, a…

Academic writing is a salient skill for medical students all over the world. Academic writing starts with composing effective paragraphs, laying the foundation for students' advancement in writing during college. This study investigated common mistakes in English paragraph writing committed by the first-year medical students of the Medicine…

In a rapidly changing information landscape, science communicators need to find new ways to engage audiences, make their information memorable and increase attitudes towards scientists. Evidence suggests that stories could be an effective tool for these goals, but few studies tested experimentally whether they are advantageous to non-stories in…

We undertook a research project consisting of four interrelated studies, in order to shed light on ways educational professionals make sense and make use of educational data in general and school performance feedback in particular. Theoretical insights illuminate why a sensemaking perspective is an appropriate and valuable lens to study data use.…

Test score comparability in international large-scale assessments (LSA) is of utmost importance in measuring the effectiveness of education systems and understanding the impact of education on economic growth. To effectively compare test scores on an international scale, score linking is widely used to convert raw scores from different linguistic…

Automated explanatory feedback systems play a crucial role in facilitating learning for a large cohort of learners by offering feedback that incorporates explanations, significantly enhancing the learning process. However, delivering such explanatory feedback in real-time poses challenges, particularly when high classification accuracy for…

In data collected from virtual learning environments (VLEs), item response theory (IRT) models can be used to guide the ongoing measurement of student ability. However, such applications of IRT rely on unbiased item parameter estimates associated with test items in the VLE. Without formal piloting of the items, one can expect a large amount of…

Individual response style behaviors, unrelated to the latent trait of interest, may influence responses to ordinal survey items. Response style can introduce bias in the total score with respect to the trait of interest, threatening valid interpretation of scores. Despite claims of response style stability across scales, there has been little…

This study seeks to investigate the impact of a real-time multi-peer feedback process with the use of a web-based polling software on adult e-learners' learning performance. Two groups of participants with 30 members in each were involved in the experiment. In the two-and-a-half-hour experiment, the experimental group adopted a web-based polling…

In-text comments, in the form of annotations on students' work, are a form of feedback information that should guide students to take action. Both the focus of the in-text comments, and the ways in which they are linguistically communicated, have potential to impact upon the way in which they are perceived by students. This study reports on an…