Many researchers have evaluated how characteristics of feedback may influence trainee performance, but relatively little attention has been allocated to directly assessing trainee preference for feedback characteristics and its relation to performance. Thus, the primary purpose of this study was to use a within-subject experimental design to…

As computer-based testing becomes more prevalent, the attention paid to response time (RT) in assessment practice and psychometric research correspondingly increases. This study explores the rate of Type I error in detecting preknowledge cheating behaviors, the power of the Kullback-Leibler (KL) divergence measure, and the L person fit statistic…

Item response theory (IRT) is currently the dominant methodological paradigm in educational and psychological measurement. IRT models are based on assumptions about the relationship between latent traits and observed responses, so the accuracy of the methodology depends heavily on the reasonableness of these assumptions. This dissertation consists…

Since Gisela Granena's influential work, LLAMA D v2, a sound recognition subtest of LLAMA aptitude tests, has been used as a measure of implicit learning aptitude in second language acquisition research. The validity of this test, however, is little known and the results of studies with this instrument have been somewhat inconsistent. In this…

Visual inspection of luggage using X-ray technology at airports is a time-sensitive task that is often supported by automated systems to increase performance and reduce workload. The present study evaluated how time pressure and automation support influence visual search behavior and performance in a simulated luggage screening task. Moreover, we…

The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

The essay reports two studies on confirmatory factor analysis of speeded data with an effect of selective responding. This response strategy leads test takers to choose their own working order instead of completing the items along with the given order. Methods for detecting speededness despite such a deviation from the given order are proposed and…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

This study explored the use of stealth assessments within a digital game to assess second language (L2) Chinese learners' reading comprehension. Log data tracking learners' in-game behaviors from a game designed for Chinese dual language immersion classrooms (Poole et al., 2022) were used to construct Bayesian Belief Networks to model reading…

Disengaged responding is a phenomenon that often biases observed scores from achievement tests and surveys in practically and statistically significant ways. This problem has led to the development of methods to detect and correct for disengaged responses on both achievement test and survey scores. One major disadvantage when trying to detect…

Changepoints are abrupt variations in a sequence of data in statistical inference. In educational and psychological assessments, it is pivotal to properly differentiate examinees' aberrant behaviors from solution behavior to ensure test reliability and validity. In this paper, we propose a sequential Bayesian changepoint detection algorithm to…

Objective: Little is known about cognition's effect on jump-landing movement patterns. Design: Participants completed three baseline cognitive tasks. Then, participants performed three jump-landing trials per condition (dual-task trials (DT)): Stroop Color Word test (SCWT), Symbol Digits Modalities test (SDMT), Brooks Visuospatial task (BVT), and…

Analysis of second language (L2) learners' language development can allow valid and reliable assessment of the learners' L2 linguistic knowledge, which can enable the teachers and researchers to choose appropriate teaching or experimental materials (Bardovi-Harlig & Bofman, 1989; Wolfe-Quintero et al., 1997). However, most language development…

A large data set of L1 psycholinguistic norms (Balota "et al." 2007) was used to assess spoken L2 English lexical proficiency in cross-sectional and longitudinal learner corpora. Behavioral norms included lexical decision and word naming latencies (i.e. reaction times) and accuracies for 40,481 English words. A frequency measure was…

Three experiments investigated the learning of simple associations in a color-word contingency task. Participants responded manually to the print colors of 3 words, with each word associated strongly to 1 of the 3 colors and weakly to the other 2 colors. Despite the words being irrelevant, response times to high-contingency stimuli and to…