This study represents the inaugural attempt at assessing the authenticity of the tasks encompassed in the IELTS Speaking Module. The evaluation is conducted from the vantage points of applied linguistics and general education, and serves to enhance comprehension of authenticity and authentic assessment. In order to achieve this objective, an…

The high-stakes College English Test (CET), developed, administered, and reformed over the last 20 years, has received great attention in the aspect of washback on teaching and learning from previous research. Very few studies explored its consequences in the workplace domain--being used as a screening lever. This research aimed to 1) compare…

This paper examines recent reforms in English-language testing in Japan using a policy distraction framework. We identify the term 'washback (effect)' and other related discourses as major distractors and investigate how 'washback' discourses have functioned as political slogans or catchphrases in policy deliberation processes and how they have…

Research has found that the "a"-stratified item selection strategy (STR) for computerized adaptive tests (CATs) may lead to insufficient use of high a items at later stages of the tests and thus to reduced measurement precision. A refined approach, unequal item selection across strata (USTR), effectively improves test precision over the…

We investigated the use and validity of standardized achievement tests for summative evaluation of 78 educational intervention projects funded by the Institute of Education Sciences (IES) math and science education program. Investigators from 46 projects evaluated curricular interventions with standardized achievement tests as outcome measures.…

Objective: To analyze the literature in which researchers have utilized the National College Health Assessment (NCHA) I or the NCHA II. Participants and Methods: The authors selected peer-reviewed articles published between 2004 and July 2013 utilizing a single search term: National College Health Assessment. Articles were assessed for instrument…

Educational administration is a rich domain of scholarship and practice, but one subject rarely discussed is its dark side. This study explored the question: What types of maladministration occur in schooling systems? The goal was to develop findings to inform existing prevention strategies. Focused on the Canadian context, data sources included…

Taking commercial English language tests is becoming common practice among young English learners in Japan. With a specific focus on the "Jido Eiken" test, this study examines English language test-taking activity by analyzing textual data retrieved from three data sources. "Jido Eiken" is found to represent a complex…

Recently, there has been a change from traditional language testing approaches, with a focus on psychometric properties towards critical language testing (CLT) with its social practice nature. CLT assumes tests not as neutral devices but as instruments of power and control which are related to authorities' policy agendas to shape individuals' and…

This article describes a study, from a Canadian technical institute's upgrading mathematics course, where students played a role in developing the final closed-book exam that they sat. The study involved a process where students developed practice exams and solutions keys, students sat each other's practice exams, students evaluated classmates'…

One consequence of test use in the English-language teaching community is the negative washback of tests on teaching and learning. Test preparation courses are often seen as part of the more general issue of washback. IELTS and TOEFL iBT tests, focusing on communicative competence, are anticipated to have positive washback effect on how English is…

Examined whether variations in construction and scoring (frequency, sum, average scores) of life events scale (stress measure) for adolescents yielded different outcomes. Findings from 1,740 high school students indicated that frequency of life events and their average intensity were distinct measures and of equal importance when assessing stress…

The utility of general or select response formats for evaluating certain types of clinical competence is studied. Consideration of the suitability of an examination format to fulfill its intended purpose and the appropriateness of the questions included is recommended when designing an examination. (Author/AL)

A University of Hawaii study compared objective and subjective assessments of the three-step triple jump examination which tests medical students' clinical problem-solving processes. Subjects were 58 first-year students. Results found the subjective assessments were more consistent across problems of varying difficulty level than were objective…

Describes a study to determine if the Areas of Change Questionnaire (AC) items represent commonly occurring problems seen by marital therapists and identified by Geiss and O'Leary (1981). Results suggest that AC Questionnaire, containing 13 of Geiss and O'Leary's 29 marital problem categories, is limited in the range of clinical marital problems…