Feedback penetrates many walks of our lives, and its importance in L2 teaching and assessment is well recognised. However, while corrective feedback and writing feedback have been the focus of much L2 research and classroom practice, there seems relatively little attention to feedback on spoken interactional skills. Concomitantly, translating…

This paper introduces an application of cross-classified item response theory (IRT) modeling to an assessment utilizing the embedded standard setting (ESS) method (Lewis & Cook). The cross-classified IRT model is used to treat both item and person effects as random, where the item effects are regressed on the target performance levels (target…

Exams are designed to rank students objectively by their abilities, including elements such as time limits, the number and difficulty of questions, and negative marking policies. Using data from a lab-in-field experiment, we develop and estimate a model of student behavior in multiple-choice exams that incorporates the effects of time constraints…

Acquiescence is the tendency of participants to shift their responses to agreement. Lechner et al. (2019) introduced the following mechanisms of acquiescence: social deference and cognitive processing. We added their interaction into a theoretical framework. The sample consists of 557 participants. We found significant medium strong relationship…

Background/purpose: This study aimed to reveal the accuracy of estimation of multiple-choice test items parameters following the models of the item-response theory in measurement. Materials/methods: The researchers depended on the measurement accuracy indicators, which express the absolute difference between the estimated and actual values of the…

Many researchers have evaluated how characteristics of feedback may influence trainee performance, but relatively little attention has been allocated to directly assessing trainee preference for feedback characteristics and its relation to performance. Thus, the primary purpose of this study was to use a within-subject experimental design to…

Objective: The objective of this study was threefold: (a) to create a rubric for response complexity (RC), defined as an admixture of response length, grammatical diversity, categorisation, and sophistication; (b) to measure behavioural and cognitive engagement through students' written responses on a school-based written activity, and (c) to…

This study presents a comparative analysis of classical reliability measures, including Cronbach's alpha, test-retest, and parallel forms reliability, alongside modern psychometric methods such as the Rasch model and Mokken scaling, to evaluate the reliability of C-tests in language proficiency assessment. Utilizing data from 150 participants…

To mitigate the potential damaging consequences of rapid guessing (RG), a form of noneffortful responding, researchers have proposed a number of scoring approaches. The present simulation study examines the robustness of the most popular of these approaches, the unidimensional effort-moderated (EM) scoring procedure, to multidimensional RG (i.e.,…

Although self-assessment in critical thinking is thought to help students recognise their strengths and weaknesses, the reliability and validity of the assessment tool is still questionable, so a more objective evaluation is needed. Objective of this investigation is to assess the self-assessment tools in evaluating students' critical thinking…

The emergence of digital game types has opened up significant opportunities to facilitate language acquisition through feedback provision, attracting diverse research strands to explore their potential as arenas for technology-assisted language learning. This study investigates the effects of learner-, peer-, and collaborative-regulated feedback…

This study evaluates the Children's Worlds Psychological Well-Being Scale (CW-PSWBS) within a diverse international cohort of children aged 10 and 12, utilising Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies. Through a detailed psychometric analysis, this research assesses the CW-PSWBS's structural integrity, focusing on…

Escape rooms are collaborative puzzle solving activities that require the participants to utilize logical reasoning and teamwork. With a slight refocusing on previously acquired knowledge, escape rooms can also be used to test and promote learning of certain topics. This paper describes the development of a one-hour in-person STEM focused escape…

Purpose: The purpose of this study is to develop an intelligent tutoring system (ITS) for programming learning based on information tutoring feedback (ITF) to provide real-time guidance and feedback to self-directed learners during programming problem-solving and to improve learners' computational thinking. Design/methodology/approach: By…

This study aimed to reveal the differences in individuals' abilities, their standard errors, and the psychometric properties of the test according to the two methods of applying the test (electronic and paper). The descriptive approach was used to achieve the study's objectives. The study sample consisted of 74 male and female students at the…