Purpose: In conjunction with curricular changes, a process to develop integrated examinations was implemented. Pre-established guidelines were provided favoring vignettes, clinically relevant material, and application of knowledge rather than simple recall. Questions were read aloud in a committee including all course directors, and a reviewer…

The purpose of this study is to investigate the effectiveness of response modes by item and feedback type in a web-based language learning program. The subjects of this study, 122 Korean tenth graders learning English as a foreign language, were placed into groups of four and were given a web-based language learning program consisting of two…

This study utilized early reading assessment data from a randomized trial of 210 urban and rural schools in Texas to examine contextual effects on risk prediction in first and second grade. The primary objective was to examine the roles of (a) individual differences, (b) the grade 1 classroom, and (c) the pairing of first and second grade teachers…

The Test of Spoken English (TSE) is an internationally administered instrument for assessing nonnative speakers' proficiency in speaking English. The research foundation of the TSE examination described in its manual refers to two sources of variation other than the achievement being measured: interrater reliability and internal consistency.…

Test developers continue to struggle with the technical and logistical problems inherent in assessing achievement across different languages. Many testing programs offer separate language versions of a test to evaluate the achievement of examinees in different language groups. However, comparisons of individuals who took different language…

This paper investigates the performance of CATSIB (a modified version of the SIBTEST computer program) to assess differential item functioning (DIF) in the context of computerized adaptive testing (CAT). One of the distinguishing features of CATSIB is its theoretically built-in regression correction to control for the Type I error rates when the…

Using an anchor-item design of test equating, the effects of three equating methods (Tucker linear and two three-parameter item-response-theory-based (3PL-IRT) methods), and the content representativeness of anchor items on the accuracy of equating were examined; and an innovative way of evaluating equating accuracy appropriate for the particular…

Bringing structure to the reading assessment process, this paper presents a draft proposal of an assessment structure which practitioners can follow, one which can be applied systematically within the Instructional Support Team process across Pennsylvania. After some background information, the paper briefly discusses features of effective reading…

By being creative in preparing tests and by allowing creativity on the part of students, language teachers can incorporate many of the principles associated with proficiency-oriented instruction into a traditional test format. Such test strategies are based on the following: (1) testing in context is better than testing with a series of unrelated…

The topic of this paper is the second of a two-faceted problem involving achievement testing in the United States. The first facet is the lack of correspondence between test content and intended student outcomes in school districts, and the second facet is "test score pollution." Test score pollution describes instances where test scores for a…

The first purpose of this study was to investigate the stability of two essential dimensionality measures across 10 random samples within a particular assessment item (AT1) selection. Other purposes were to investigate the discrepancy of the essential unidimensionality estimates for a test across different AT1 selections and sample sizes and to…

The major purpose of the three studies reported here was to investigate possible differences in agreement/disagreement with attitude statements as a function of their type (with regard to positivity/negativity) and personalism. In the first study, 90 students completed scales on energy conservation and on having good study habits. Agreement varied…

A study examined state-mandated literature assessment procedures and undertook a content analysis of tests produced by proprietary testing companies and textbook producers in order to ascertain how literature achievement is assessed in the United States. Results indicated that 61% of the school systems assess literature as part of an assessment of…

This study of survey research experts was conducted to determine desirable characteristics of mail questionnaires. The 82-item Likert-scale instrument used in the study covered general appearance, instructions, choice of items, choice of response options, wording, order of items, and item format. The instrument was administered to: 8 subjects who…

A sample of 150 Japanese English-as-a-Second-Language students at Southern Illinois University, Carbondale was given a reading comprehension test containing three levels of questions: factual, generalization, and inference, to measure comprehension effects at different proficiency strata. The results indicated that there were significant…