The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses…

The teaching of English as a foreign language in Indonesia has a long history, and it is always important to ask whether the assessment of the students' language skills has been valid and reliable. A screening of many articles in several prominent databases reveal that a number of evaluation studies have been done by Indonesian scholars in the…

The purpose of this article of reflection is to raise awareness of how poor design of language assessments may have detrimental effects, if crucial qualities and technicalities of test design are not met. The article first discusses these central qualities for useful language assessments. Then, guidelines for creating listening assessments, as an…

In the test-centric Thai education system, results on national exams are often viewed as indicators of educational success. These exams use multiple-choice which can have detrimental effects on students' attitudes and learning. If school assessments also rely on multiple-choice exams, the situation would be worrying, yet there is little data…

The Ordinary National Educational Test (O-NET), the national examination in Thailand, plays as a high-stakes test at an upper secondary school level as it can be used as a tool for several purposes in education such as gatekeepers for the university entry and measures for the teaching quality evaluation. English, out of the five core subjects in…

This article is mainly concerned with a study of the relation between the content of a multiple choice test and its composition, from the point of view of those features in tests which enable the testee to derive the correct answer by studying the composition of the test itself. (Author/POP)

Discusses the problem of testing with particular regard to the evaluation of aural-oral skills within a modern methodological context. The use of pictures, paragraphs, and dialogs to test listening skills and of pictures and micro-dialogs to test speaking skills is described. (SED)

A study investigated the effectiveness of the Rasch procedure in measuring response appropriateness, especially for the detection of cheating on multiple-choice language tests. The report gives background information on appropriateness measurement and its potential uses, reviews recent research on cheating and its detection, and describes three…

"Background": There are very few formal language assessments aimed at the very severely neurologically impaired individual. These individuals often have multiple deficits on top of their communication impairment that demand a novel approach to assessment. The authors set out to devise a tool (PASWORD) to enable professionals in this field to…

ALTHOUGH MOST EDUCATORS AGREE THAT EXAMINATIONS PERFORM AN IMPORTANT FUNCTION IN APPRAISING STUDENT ACHIEVEMENT, SOME CLAIM THAT MULTIPLE CHOICE TESTS DEGENERATE INTO A GAME OF "BEAT THE MONKEY," I.E., ANSWERING MORE THAN 25 PERCENT OF THE ITEMS CORRECTLY, THE RATING EVEN A MONKEY COULD BE EXPECTED TO RECEIVE. SAMPLE STUDIES REVEAL THAT THE…

The construction of objective tests for native language reading comprehension is described. The tests were designed for the early secondary school years in several kinds of schools, vocational and non-vocational. The description focuses on the use of the Rasch model in test development, to develop a large pool of homogenous items and establish…

The traditional multiple-choice reading comprehension test of English as a second language, used in the Dutch school-leaving examinations, has been criticized for its apparent lack of construct validity. The Dutch National Institute for Educational Measurement has conducted a number of studies to determine whether there is a different skill…

This is a teacher's guide for "Poor Simpleton," a language test designed for students of English in bilingual programs. The guide explains the nature of the test, how to administer and score it, and how to analyze test results. The test is a modified version of the cloze procedure. Unlike most cloze tests, which are…