Two independent statistical tests of item compromise are presented, one based on the test takers' responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are…

Questionnaire design choices, such as handling 'do not know' answers or using check all that apply questions may impact the level of item- and unit nonresponse. We used experimental data from an online panel and the questions of ESS to examine how applying forced answering, offering DK/NA options and specific question formats (CATA vs. forced…

Item Response Theory models with varying thresholds are essential tools to account for unknown types of response tendencies in rating data. However, in order to separate constructs to be measured and response tendencies, specific constraints have to be imposed on varying thresholds and their interrelations. In this article, a multidimensional…

Embracing a positive-psychology approach to well-being, this study aimed at identifying how to maximize students' pleasure when receiving grades. Results from two experiments showed that students gained greater pleasure when receiving feedback in letter-grade format than in percentage scores. The results are consistent with social-psychological…

Within Australian higher education, student evaluation of teaching (SET) is regularly conducted and data are utilised for quality control and staff appraisal. Within current methodologies, students can anonymously provide further feedback as written commentary. There is now growing evidence that, once this narrative becomes derogatory or abusive,…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

The study aims to introduce to the Turkish culture a measurement tool that has proven validity and reliability in determining the level of quiet quitting among teachers. It involves the analysis of the validity and reliability of the Quiet Quitting Scale, as the scale is adapted to the Turkish culture. The scale, originally developed in English,…

Background: Developments in educational technology and learning analytics make it possible to automatically formulate and deploy personalized formative feedback to learners at scale. However, to be effective, the motivational and emotional impacts of such automated and personalized feedback need to be considered. The literature on feedback…

How do teachers perceive and experience the impact of evaluation feedback across various domains of their work? This study investigates whether there are qualitatively distinct groups of teachers in the United States based on teacher perceived impact of evaluation feedback using the 2013 Teaching and Learning International Survey (TALIS 2013).…

This qualitative case study explores the story of celebration for kindergarten teachers at a suburban elementary school in northern New England. This study explored the reality of self-celebration in kindergarten teachers' current practices during staff meetings, planning meetings, response to intervention (RTI) meetings, with their colleagues,…

In this article, the author revisits and expands on the insights shared during a panel discussion at the 2022 Assessment Institute, with a focus on exploring and perhaps challenging thinking around what assessment is, how this work is viewed by many stakeholders critical to the assessment process, and the "feast or famine" conditions…

If there is one thing all university rankings have in common, it is that they are the target of widespread criticism. This article takes the many challenges university rankings are facing as its point of departure and asks how they navigate their hostile environment. The analysis proceeds in three steps. First, we unveil two modes of ranking…

What would it be like to learn to live in and experience a world of sentient beings rather than inert objects? How can we learn to awarely participate in a world of communication and interaction, in which trees, crows and rivers may grace us with a response to our attention and our call? How do we learn not just to know this intellectually but…

My dissertation research explored responder behaviors (e.g., demonstrating response styles, carelessness, and possessing misconceptions) that compromise psychometric quality and impact the interpretation and use of assessment results. Identifying these behaviors can help researchers understand and minimize their potentially construct-irrelevant…

Telephone surveys face more and more criticism because of decreasing coverage and increasing costs, and the risk of producing socially desirable answers. Consequently, survey administrators consider switching their surveys to the web mode, although the web mode is more susceptible to item nonresponse. Still, we do not know whether this is true for…