While the peer feedback process has an important role to play in student learning and has many benefits, it is not without its challenges. One of these is the effect that emotions may have on the way that students engage with the feedback. Yet, the specific emotions experienced during peer feedback is relatively under-explored. Therefore, this…

Item response theory (IRT) refers to a family of mathematical models which describe the relationship between latent continuous variables (attributes or characteristics) and their manifestations (dichotomous/polytomous observed outcomes or responses) with regard to a set of item characteristics. Researchers typically use parametric IRT (PIRT)…

Statistical process control (SPC) charts have been widely used in the field of educational measurement. The cumulative sum (CUSUM) is an established SPC method to detect aberrant responses for educational assessments. There are many studies that investigated the performance of CUSUM in different test settings. This paper describes the CUSUM…

Person misfit and person reliability indices in item response theory (IRT) can play an important role in evaluating the validity of a test or survey instrument at the respondent level. Prior empirical comparisons of these indices have been applied to binary item response data and suggest that the two types of indices return very similar results.…

Classroom observation has been long considered a powerful tool for evaluating and monitoring teachers' performance and progress. Teachers can benefit from the feedback during the postobservation conference but giving feedback is not a simple skill and needs knowledge and training. Research on tackling postobservation problems remains emerging and…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

Within Australian higher education, student evaluation of teaching (SET) is regularly conducted and data are utilised for quality control and staff appraisal. Within current methodologies, students can anonymously provide further feedback as written commentary. There is now growing evidence that, once this narrative becomes derogatory or abusive,…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

The study aims to introduce to the Turkish culture a measurement tool that has proven validity and reliability in determining the level of quiet quitting among teachers. It involves the analysis of the validity and reliability of the Quiet Quitting Scale, as the scale is adapted to the Turkish culture. The scale, originally developed in English,…

Background: Developments in educational technology and learning analytics make it possible to automatically formulate and deploy personalized formative feedback to learners at scale. However, to be effective, the motivational and emotional impacts of such automated and personalized feedback need to be considered. The literature on feedback…

How do teachers perceive and experience the impact of evaluation feedback across various domains of their work? This study investigates whether there are qualitatively distinct groups of teachers in the United States based on teacher perceived impact of evaluation feedback using the 2013 Teaching and Learning International Survey (TALIS 2013).…

Teachers focused on prevention of academic problems should apply procedures that enhance learning speed, or learning as a function of the time that the learner spends engaged in the intervention(s). Although few researchers evaluate or compare academic interventions using precise measures of learning speed, several strategies for modifying…

Two independent statistical tests of item compromise are presented, one based on the test takers' responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are…

Questionnaire design choices, such as handling 'do not know' answers or using check all that apply questions may impact the level of item- and unit nonresponse. We used experimental data from an online panel and the questions of ESS to examine how applying forced answering, offering DK/NA options and specific question formats (CATA vs. forced…

This study examines the impact of feedback assisted by generative artificial intelligence (GAI) on the dynamics and outcomes of online inquiry-based discussions (IBDs) in a higher education context. Specifically, it compares two distinct feedback types powered by GAI: idea-oriented and task-oriented. The study involved 105 preservice teachers from…