As information and communication technologies develop in China, language tests are shifting from conventional paper-and-pencil testing to computerized testing. The aim of this study is to investigate Chinese test-takers' adaptability to computerized language exams, including their performance across testing modes and their perception of the…

While there is growing research identifying the academic and nonacademic challenges to the wellbeing of Chinese international students, there is little discussion about the differences in and challenges of the assessment they experience. This gap appears to come from a tacit assumption that assessment is universal worldwide, or that students will…

Much psychological research depends on participants' diligence in filling out materials such as surveys. However, not all participants are motivated to respond attentively, which leads to unintended issues with data quality, known as careless responding. Our question is: how do different modes of data collection--paper/pencil, computer/web-based,…

This research examined the Chinese National College Entrance Examination (NCEE) in mathematics before and after the Great Proletarian Cultural Revolution, specifically covering the periods 1952-1965 and 1977-1984. The central focus was on the organization, structure, and content of the examinations, as well as their influence on and interaction…

Problem-solving categorization tasks have been well studied and used as an effective tool for assessment of student knowledge structure. In this study, a traditional free-response categorization test has been modified into a multiple-choice format, and the effectiveness of this new assessment is evaluated. Through randomized testing with Chinese…

The effects of question or task complexity on second language speaking have traditionally been investigated using complexity, accuracy, and fluency measures. Response processes in speaking tests, however, may manifest in other ways, such as through nonverbal behavior. Eye behavior, in the form of averted gaze or blinking frequency, has been found…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…

The main purpose of this study is to investigate guessing in the Yes/No (YN) format vocabulary test. One-hundred-and-five university students took a YN test, a translation task and a multiple-choice vocabulary size test (MC VST). With matched lexical properties between the real words and the pseudowords, pseudowords could index guessing in the YN…

Given the practical significance of vocabulary testing in language teaching and the theoretical foundations of developing a vocabulary test, four well-established vocabulary tests are introduced for diagnostic purpose together with their corresponding validation studies, with a focus on the designed purpose, the selection of the items, the…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

We examine the effects of computer-based versus paper-based assessment of critical thinking skills, adapted from English (in the U.S.) to Chinese. Using data collected based on a random assignment between the two modes in multiple Chinese colleges, we investigate mode effects from multiple perspectives: mean scores, measurement precision, item…

Interim testing of studied information, compared with restudying or no treatment, facilitates subsequent learning and retention of new information--"the forward testing effect." Previous research exploring this effect has shown that interim testing of studied information from a given domain enhances subsequent learning and retention of…

This study explored the role of vocabulary breadth and depth in second language learners' performance in IELTS academic reading tests in China. Sixty-two Chinese learners of English as a foreign language completed a vocabulary size test, a vocabulary depth test, and an IELTS reading test. Results showed that vocabulary breadth and depth both…

Background: This study aims to empirically answer the question of whether the role of sub-reading skills changes depending on the test format (e.g., multiple-choice vs. open-ended reading questions). The test format effect also addresses the issue of test validity--whether the reading test properly elicits construct-relevant reading skills or…

Vignette design has been largely neglected in anchoring vignette studies. This study aimed to contribute to the science of vignette design by developing and evaluating vignettes for measuring vision in rural China. Cognitive interviews were conducted among 36 participants in a Chinese middle school. The respondents either directly evaluated vision…