This study addresses how Chinese learners of English as a second language (L2) perceive conversations in English materials as compared to speakers of English as a first language (L1). Data were collected through questionnaires completed by 48 participants (28 L2 English learners in China and 20 L1 English speakers in the UK), eliciting evaluations…

In this quasi-experimental study, the effects of lexical coverage through pseudo word manipulation in dialogue comprehension are investigated. Forty-four first-year students in a Japanese university listened to five dialogues at different lexical coverage levels: 98%, 95%, 90%, 85%, and 83%. The results of the comprehension tests confirm the…

Combining Bachman's (1990) conceptualization of content validity with Messick's (1989) unifying model of construct validity, this study attempted to fill the gap in researching content validation in the context of a university reading achievement test by (a) examining traditional content validity evidence and (b) analyzing the test scores to…

Focusing on the reflective exchanges of four test writers at an intensive language school within a public university, this study explored the effectiveness of a "lesson study" model on their professional development as test writers. Lesson study is a powerful tool for teachers' professional development and a modified version of it--a…

The purpose of this study was to investigate the impact of a cheating prevention strategy employed for a professional credentialing exam that involved releasing over 7,000 active and retired exam items. This study evaluated: 1) If any significant differences existed between examinee performance on released versus non-released items; 2) If item…

This study examined the validity of trilingual test as a test accommodation to assess the Indigenous pupils' mathematical performance in Malaysia. The study employed two tests; BM-only test with items written in Malay language (BM) and trilingual test, which had items written in BM and English, and oral audio recording in their native Temiar…

To measure the response style of acquiescence, researchers recommend the use of at least 15 items with heterogeneous content. Such an approach is consistent with its theoretical definition and is a substantial improvement over traditional methods. Nevertheless, measurement of acquiescence can be enhanced by two additional considerations: first, to…

Gender differences in reading seem to increase throughout schooling and then decrease or even disappear with age, but the reasons for this are unclear. In this study, we explore whether differences in the way "reading literacy" is operationalised can add to our understanding of varying gender differences in international large-scale…

This report is the third in a series considering career-readiness features within high school assessments. The goal of this study was to explore international comparisons by applying feature analysis to Korean assessment items. Twenty math test items from the Gyeonggi Province in South Korea along with performance data from roughly 4,000 Grade 12…

The United States and the United Kingdom have used standardized high-stakes testing as a measurement of students' cognitive level to determine success in the 21st century. Standardized tests have given teachers guidance to help them determine what to teach students and how to teach to the test. With such increased emphasis on high-stakes…

Background: In 2011 the Progress in International Reading Literacy Study (PIRLS) and the Trends in International Mathematics and Science Study (TIMSS) were conducted at fourth grade in a number of participating countries with a shared representative sample. In this article we investigate whether there are multidimensional proficiency patterns…

This study followed the comparative research mode of description, interpretation, juxtaposition and comparison. Based on the literatures and data collected on the topic, the paper compared and analyzed the past, present and future of APTHS (academic proficiency test for high schools) in the two countries. Some contemplations on the common issues…

Most professors use examinations as an important assessment tool to aid in determining the level of student subject matter comprehension. We also use the feedback from examinations as an indicator of the appropriateness and effectiveness of the teaching methodologies we are utilizing in the classroom. This paper is a follow-up to a 2006-2007 study…

The purpose of this document is to provide background information that will be useful in interpreting the 2007 results from the Trends in International Mathematics and Science Study (TIMSS) by comparing its design, features, framework, and items with those of the U.S. National Assessment of Educational Progress and another international assessment…

This article reports the performance of 15-year-old Hong Kong students in mathematical literacy in an international study called PISA 2000, in which Hong Kong has topped the list of 41 participating countries/regions, with a mean score significantly higher than all other countries except Japan and Korea. With the conceptual framework developed by…