The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses…

The teaching of English as a foreign language in Indonesia has a long history, and it is always important to ask whether the assessment of the students' language skills has been valid and reliable. A screening of many articles in several prominent databases reveal that a number of evaluation studies have been done by Indonesian scholars in the…

The purpose of this article of reflection is to raise awareness of how poor design of language assessments may have detrimental effects, if crucial qualities and technicalities of test design are not met. The article first discusses these central qualities for useful language assessments. Then, guidelines for creating listening assessments, as an…

In the test-centric Thai education system, results on national exams are often viewed as indicators of educational success. These exams use multiple-choice which can have detrimental effects on students' attitudes and learning. If school assessments also rely on multiple-choice exams, the situation would be worrying, yet there is little data…

The Ordinary National Educational Test (O-NET), the national examination in Thailand, plays as a high-stakes test at an upper secondary school level as it can be used as a tool for several purposes in education such as gatekeepers for the university entry and measures for the teaching quality evaluation. English, out of the five core subjects in…

The application of high-stakes tests to choose students for higher education in Turkey has been considered as a reliable and effective way of assessment for so long. However, the application of a multiple-choice test in testing various skills could bring a number of side-effects with itself. This study aimed to investigate the backwash effect of…

ALTHOUGH MOST EDUCATORS AGREE THAT EXAMINATIONS PERFORM AN IMPORTANT FUNCTION IN APPRAISING STUDENT ACHIEVEMENT, SOME CLAIM THAT MULTIPLE CHOICE TESTS DEGENERATE INTO A GAME OF "BEAT THE MONKEY," I.E., ANSWERING MORE THAN 25 PERCENT OF THE ITEMS CORRECTLY, THE RATING EVEN A MONKEY COULD BE EXPECTED TO RECEIVE. SAMPLE STUDIES REVEAL THAT THE…