This study investigates the comparability of three parallel translation tasks selected from a College English Test Band-6 (CET-6) and explores the major linguistic features contributing to translation difficulty. Data obtained from the participants' subjective rating, eye-tracking, and performance evaluation were triangulated to measure the…

Teaching simulations such as scriptwriting tasks offer a novel way to support pre-service teachers in gaining diagnostic competencies and in guiding students to work through difficulties. We first report on the theory-driven development of a scriptwriting task, specifically the theoretically-founded language- and accompanying content-related…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students' performance on…

Each game within the Ignite by Hatch™ gaming environment belongs to an overall developmental domain and skills-based subdomain and is intended to meet the developmental needs of children at specific skill levels. These skill levels (Beginning, Emerging, Intermediate, Accomplishing, and Proficient+) form an intended developmental pathway. Children…

This study investigated the effectiveness of using a social learning programme facilitated by Facebook to develop some creative writing skills and motivation to learn English among secondary-one school students. Seventy students in secondary-one grade in Al-Shahid Hussein A. Abdul-Raouf Mixed Secondary School in Al-Maabda in the second semester of…

The current study proposes novel methods to predict multistage testing (MST) performance without conducting simulations. This method, called MST test information, is based on analytic derivation of standard errors of ability estimates across theta levels. We compared standard errors derived analytically to the simulation results to demonstrate the…

Purpose: To produce a novel, efficient measure of children's expressive vocal development on the basis of automatic vocalization assessment (AVA), child vocalizations were automatically identified and extracted from audio recordings using Language Environment Analysis (LENA) System technology. Method: Assessment was based on full-day audio…

According to Acceptance and Commitment Therapy (ACT), "psychological flexibility" refers to an individual's ability to maintain mindful awareness of his or her thoughts and emotions in the present moment while behaving according to his or her personal values. Psychological inflexibility could set the foundation for emotional distress and…

The aim of this study is to observe the effect of Education and Informatics Net (EIN) supported math teaching on students' success in geometry teaching 5th grade level and to observe students' comments on EIN. This study was conducted in the 2nd term of 2018-2019 school year. Both qualitative and quantitative research methods were implemented.…

Co-design is fundamental to humanitarian engineering and increasingly recognised as such in engineering curricula. However, it is challenging to teach, learn, and assess. In this paper, we describe the development and validation of a scenario-based instrument to distinguish novice and expert approaches to co-design in the context of humanitarian…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

Validity is one of the psychometric properties of the achievement tests. To determine the validity, one of the examination is item bias studies, which are based on differential item functioning (DIF) analyses and field experts' opinion. In this study, field experts were asked to estimate the DIF levels of the items to compare the estimations…

History education scholars have recognized the need for test validity research in recent years and have called for empirical studies that explore how to best measure historical thinking processes. The present study was designed to help answer this call and to provide a model that others can adapt to carry this line of research forward. It employed…