Despite consistent calls for authentic stimuli in listening tests for better construct representation, unscripted texts have been rarely adopted in high-stakes listening tests due to perceived inefficiency. This study details how a local academic listening test was developed using authentic unscripted audio-visual texts from the local target…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

Problem-solving categorization tasks have been well studied and used as an effective tool for assessment of student knowledge structure. In this study, a traditional free-response categorization test has been modified into a multiple-choice format, and the effectiveness of this new assessment is evaluated. Through randomized testing with Chinese…

This study was to compare the processes that second language learners implemented when completing reading tasks in a multiple-choice question format (MCQ) with those in a short-answer question format (SAQ). Sixteen nonnative English-speaking students from a large Midwestern college in the United States were invited to complete MCQ and SAQ English…

The mass shift to Open-Book, Open-Web (OBOW) assessments during the pandemic highlighted new opportunities in Higher Education for developing accessible, authentic assessments that can reduce administrative load. Despite a plethora of research emerging on the effectiveness of OBOW assessments within disciplines, few currently evaluate their…

This study investigates the effects that three different test presentation formats, i.e., written Korean, written English and aural English, have on EFL learners' listening comprehension. A total of 169 Korean college students participated in this study. The participants were divided into six groups, by three presentation format types and two…

Multiple test tasks are available for assessing L2 collocation knowledge. However, few studies have investigated the characteristics of a variety of recognition and recall tasks of collocation simultaneously, and most research on L2 collocations has focused on verb-noun and adjective-noun collocations. This study investigates (1) the relative…

This study investigated Korean college students' performance as measured by two different vocabulary assessment tools (the Productive Vocabulary Levels Test (PVLT) and the Productive Vocabulary Use Task (PVUT)) and the relationship these assessments have with students' writing proficiency. A total of 72 students participated in the study. The…

An English placement test (PT) is an essential component of any foundation program. It helps place students into their suitable language proficiency level so that they do not spend time learning materials below or above their levels. It also helps teachers to prepare teaching materials to students of similar levels (Brown, 2004; Illinois, 2012).…

We assessed the performance of students with a self-reported conflict between their religious belief and the theory of evolution in two sections of a large introductory biology course (N = 373 students). Student performance was measured through pretest and posttest evolution essays and multiple- choice (MC) questions (evolution-related and…

The use of integrated skills tasks in language tests has been debated for many years and international English test developers such as Educational Testing Service (ETS) and Pearson Tests of English (PTE) already use such tests to assess English as a foreign language (EFL) learners' language proficiency. Empirical research has rarely investigated…

This study analyzed effective test formats that utilized tablets for tests in university information basic subjects in blended learning environments. Specifically, three types of test were created: (1) multiple-choice, (2) fill-in-the-blank, and (3) a mixture of multiple-choice and fill-in-the-blank. An analysis focusing on university students'…

Two studies investigated the comparability of scores from paper-and-pencil and computer-administered versions of the College-Level Examination Program (CLEP) General Examinations in mathematics and English composition. The first study used a prototype computer-administered version on each examination for 94 students for mathematics and 116 for…

While computer-based tests might be as simple as computerized versions of paper-and-pencil examinations, more innovative applications also exist. Examples of innovations in computer-based assessment include the use of graphics or sound, some measure of interactivity, a change in the means in which examinees responded to items, and the application…

A study was undertaken to obtain direct empirical evidence for the validity and usefulness of English as a second language (ESL) placement of a shortened version of the Secondary Level English Proficiency (SLEP) Test being used in the Los Angeles Community College District (LACCD) and locally developed and scored writing tests. The LACCD provided…