The American Council on the Teaching of Foreign Languages (ACTFL) oral proficiency interview -- computer (OPIc) testing system represents an ambitious effort in language assessment: Assessing oral proficiency in over a dozen languages, on the same scale, from virtually anywhere at any time. Especially for users in contexts where multiple foreign…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

This article presents and analyses a classroom-based assessment method to test students' speaking skills in a variety of professional settings in tourism. The assessment system has been implemented in the Communication in English for Tourism course, as part of the Tourism Management degree programme, at Florida Universitaria (affiliated to the…

Past practice of operationalizing the concept of fakeability of psychological tests is reviewed. The strengths and weaknesses of these indices are discussed in the light of a proposed new definition of fakeability based upon Naylor's model of measurement accuracy. (Author/JKS)

Investigated reliability and dimensionality of Bales's Interpersonal Rating Forms (IRF) using volunteer subjects (N=266) enrolled in undergraduate communications course. Results documented shortcomings of IRF as a measuring instrument finding the subscales neither reliable nor dimensionally structured; only 2 of 18 items in each subscale are…

Subjects are asked to answer six questions, partly with a frequency and partly by marking a verbally anchored scale with five categories. Some univariate and multivariate analyses are performed to elucidate the relations between variables with the two different modes of response. Although there are similarities in results for the two types of…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

In attempting to meet school-board mandates for competency-based testing in composition, educators must devise the most acceptable testing programs they can. This paper describes a design (the Paul Diederich system) for testing students' writing skills, which yields statistically reliable data on individual students, and reports on a New Orleans…

This paper is part 3 of Research Department Report Number 123, "Exploring the T.R.Q.: An Assessment of the Effectiveness of the Teachers' Rating Questionnaire," which gave questionnaire users information necessary to tailor the instrument to their own needs. Retention of TRQ questions which generated good distributions of teacher ratings…

This report assesses the validity, reliability, and efficiency of the Teachers' Rating Questionnaire (TRQ), a pupils' school success measure developed in connection with a 1961 longitudinal Study of Achievement. TRQ ratings on nearly 14,000 pupils, gathered in the Study of Achievement and a New Canadian Report, constituted the data source.…

One implication of attitude self-ratings, that scales may become recalibrated transiently, was investigated conservatively using hypothesized shifts of data from 368 college students rating the desirability of taking senior comprehensive examinations. Results support the validity and reliability of simple graphic rating scales as measures of…

A STUDY OF FIVE DIFFERENT ESSAY EVALUATION PROCEDURES WAS CONDUCTED TO DETERMINE THE INTRARELIABILITY OF EACH AND TO USE THESE RELIABILITY SCORES AS A BASIS FOR COMPARING THE FIVE PROCEDURES. TEN THEMES WERE ASSIGNED TO FIVE RATING GROUPS, EACH USING A DIFFERENT EVALUATION PROCEDURE--(1) THE CALIFORNIA ESSAY SCALE, (2) THE CLEVELAND COMPOSITION…

Several methodological problems (particularly the assumed bipolarity of scales, instructions regarding use of the midpoint, and concept-scale interaction) which may contribute to a lack of precision in the semantic differential technique were investigated. Results generally supported the use of the semantic differential. (Author/JKS)

The study examines the reliability of the Community College Occupational Programs Evaluation System (COPES). The COPES process is a system for evaluating program strengths and needs. A two-way test, college self-appraisal with third party validation of the self-appraisal, is utilized to assist community colleges in future institutional planning…

A set of pilot performance reference scales was developed based upon airborne Audio-Video Recording (AVR) of student performance in T-37 undergraduate Pilot Training. After selection of the training maneuvers to be studied, video tape recordings of the maneuvers were selected from video tape recordings already available from a previous research…