Diversity audits are frequently used as an assessment method to measure the diversity of a library collection. Yet, there is not frequent research on the aftermath of diversity audits, especially in the context of comparing data from several audits to assess the difference in the makeup of a library collection. In this article, the author…

Calligraphy is the treasure of traditional Chinese culture and it is ubiquitous in China. Because of the unique aesthetic characteristics of calligraphy, the difficulty of calligraphy teaching lies in the assessment of calligraphy works. The major problems concerning calligraphy assessment are the low time efficiency of calligraphy assessment and…

This study explores the use of Large Language Models (LLMs), specifically GPT-4, in analysing classroom dialogue--a key task for teaching diagnosis and quality improvement. Traditional qualitative methods are both knowledge- and labour-intensive. This research investigates the potential of LLMs to streamline and enhance this process. Using…

This study compares cost, completion times, and percent completion of electronic tablet (n = 244) to paper-based (n = 398) questionnaires administered to participants of scenic raft trips on the Snake River, Grand Teton National Park. We hypothesized e-tablet questionnaires would (1) cost less (2) be completed faster and (3) be completely filled…

Analysis of second language (L2) learners' language development can allow valid and reliable assessment of the learners' L2 linguistic knowledge, which can enable the teachers and researchers to choose appropriate teaching or experimental materials (Bardovi-Harlig & Bofman, 1989; Wolfe-Quintero et al., 1997). However, most language development…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

Research evidence suggests children experiencing adversity are at risk of language disparities in early childhood. This puts these children at risk of poor language outcomes, perpetuating disadvantage in later development and academic life. This study aimed to investigate associations between Early Childhood Education and Care (ECEC) attendance,…

The development of web surveys has been accompanied by the emergence of new scales, taking advantages of the visual and interactive features provided by the Internet like drop-down menus, sliders, drag-and-drop, or order-by-click scales. This article focuses on the order-by-click scales, studying the comparability of the data obtained for this…

This study compares the performance of two estimation algorithms of new usage, the Metropolis-Hastings Robins-Monro (MHRM) and the Hamiltonian MCMC (HMC), with two consolidated algorithms in the psychometric literature, the marginal likelihood via EM algorithm (MML-EM) and the Markov chain Monte Carlo (MCMC), in the estimation of multidimensional…

Educational systems typically contain a large pool of items (questions, problems). Using data mining techniques we can group these items into knowledge components, detect duplicated items and outliers, and identify missing items. To these ends, it is useful to analyze item similarities, which can be used as input to clustering or visualization…

The purpose of the present study was to investigate whether a specific testing accommodation (extended time) affects test scores for college students with and without ADHD. College students with ADHD (N = 61) and without ADHD (N = 68) took a math test, after having been told they had either standard time or extended time to complete the test.…

This paper examines student responses to a small-scale pilot of peer learning in undergraduate translation classes. It examines the possible benefits and risks of a learner-centred approach and explores these through feedback from two groups of undergraduate modern language students attending translation classes over a semester at a UK university.…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

The majority of multimedia learning studies focus on the use of graphics in learning process but very few of them examine the role of graphics in testing students' knowledge. This study investigates the use of static graphics versus animated graphics in a computer-based English achievement test from a cognitive load theory perspective. Three…

Although evaluators often use an interrupted time series (ITS) design to test hypotheses about program effects, there are few empirical tests of the design's validity. We take a randomized experiment on an educational topic and compare its effects to those from a comparative ITS (CITS) design that uses the same treatment group as the experiment…