Metacognitions of agency were investigated using a computer task in which X's and O's streamed from the top of a computer screen, and the participants moved the mouse to get the cursor to touch the X's and avoid the O's. After each 15 s trial, participants made judgments of agency and judgments of performance. Objective control was either…

Temporal patterns of behavior have been observed in real-life performances such as bill passing in the U.S. Congress, in-class studying, and quiz taking. However, the practical utility of understanding these patterns has not been evaluated. The current study demonstrated the presence of temporal patterns of quiz taking in a university-level…

This article details the construction of a computer program to test cognitive processing differences in adolescents engaged in a standard presentation of tests versus a fantasy-based game presentation. The article will discuss the challenges of creating a replication of traditional psychological tests into a new medium which holds comparable…

This study explores the potential for automated indices related to speech delivery, language use, and topic development to model human judgments of TOEFL speaking proficiency in second language (L2) speech samples. For this study, 244 transcribed TOEFL speech samples taken from 244 L2 learners were analyzed using automated indices taken from…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

A usability study was conducted by the Research and Innovation Network and Assessment Solutions Design to assess the usability of a drawing response interaction type. The Partnership for Assessment of Readiness for College and Careers (PARCC) commissioned a multi-part study to determine the viability of using the drawing response interaction on…

This article reports on the content range and measurement precision of an upper extremity (UE) computer adaptive testing (CAT) platform of physical function in children with cerebral palsy. Upper extremity items representing skills of all abilities were administered to 305 parents. These responses were compared with two traditional standardized…

This article delves into a relatively unexplored area of measurement by focusing on adaptive testing with unidimensional pairwise preference items. The use of such tests is becoming more common in applied non-cognitive assessment because research suggests that this format may help to reduce certain types of rater error and response sets commonly…

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of…

In Hong Kong, onscreen marking (OSM) is superseding paper-based marking (PBM) across the entire national examinations system. This paper describes a qualitative study of the attitudes of Liberal Studies markers towards OSM. This becomes a compulsory subject in Hong Kong's new senior secondary school curriculum to be first examined in 2012, with a…

Whether an ability test delivered on either paper or computer provides the same information is an important question in applied psychometrics. Besides the validity, it is also the fairness of a measure that is at stake if the test medium affects performance. This study provides a comprehensive review of existing equivalence research in the field…

The time taken to decide whether a character is shown in its mirror or normal version has been shown to increase approximately linearly with the angular departure from an up-right position. Additionally, in some studies, decisions took longer for clockwise tilted characters than for counterclockwise tilted ones. Other studies do not report the…

In this article, we present the characteristics and the design of a modular personalized multimedia testing tool based fully on XML learning specifications. Personalization is based on the characteristics of the individual learners, thus the testing paths are tailored to their needs and goals. The system maintains learner profiles rich in content…

Three studies are presented on attention paid to feedback provided by a computer-based assessment for learning on information literacy. Results show that the attention paid to feedback varies greatly. In general the attention focuses on feedback of incorrectly answered questions. In each study approximately fifty percent of the respondents paid…

The effective design of test items within a computer-based language test (CBLT) for developing English as a foreign language (EFL) learners' listening and speaking skills has become an increasingly challenging task for both test users and test designers compared with that of pencil-and-paper tests in the past. It needs to fit integrated oral…