Reports on the potential problems in scoring responses to sequencing tests, the development of a computer program to overcome these difficulties, and an exploration of the value of scoring procedures. (Author/VWL)

This study examined the psychometric properties of the Sexual Orientation Counselor Competency Scale (SOCCS), an instrument that measures the attitudes, skills, and knowledge of counselors who work with lesbian, gay, and bisexual individuals. Internal consistency of the SOCCS was 0.90, and 1-week test-retest reliability was 0.84. Criterion,…

In this study we investigated the effects of the average signed area (ASA) between the item characteristic curves of the reference and focal groups and three test purification procedures on the uniform differential item functioning (DIF) detection via the Mantel-Haenszel (M-H) method through Monte Carlo simulations. The results showed that ASA,…

Differential item functioning (DIF) analyses are a routine part of the development of large-scale assessments. Less common are studies to understand the potential sources of DIF. The goals of this study were (a) to identify gender DIF in a large-scale science assessment and (b) to look for trends in the DIF and non-DIF items due to content,…

The paper describes the adaptation of the Adolescent version of the Alcohol Expectancy Questionnaire (AEQ-A) for university students in Peru. 672 male and female university students enrolled in the first years at a private university in Peru completed the AEQ-A translated into Spanish. All 90 items were scored on 5-point rating scales. A principal…

The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

This monograph critically examines the emerging discourse on quality associated with Education for All (EFA). It contends that EFA discourse has moved from a welcome and vital commitment to quality to its measurement without adequate consideration of what "quality" entails, particularly in the vital domain of pedagogy. Meanwhile, the…

The 1998 reauthorization of the Higher Education Act requires all states to report annually to the U.S. Department of Education the number of prospective teachers at each teacher training institution who pass their own state tests for licensure. However, the law left decisions on what tests to require in each field, what to assess on them, and…

"Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics…

The purpose of this study was to develop a valid and reliable survey instrument to be used by librarians and other educational leaders to measure implementation of a school's information literacy program. The goal was to create an instrument that would consider implementation of a library-centered program within the context and culture of the…

This paper concerns the divisibility of comprehension subskills measured in L2 listening and reading tests. Motivated by the administration of the new Web-based English as a Second Language Placement Exam (WB-ESLPE) at UCLA, this study addresses the following research questions: first, to what extent do the WB-ESLPE listening and reading items…

Objective: The objective of this study is to develop and validate the Chinese Making Sense of Adversity Scale (CMSAS) to measure the cognitive coping strategies that Chinese people adopt to make sense of adversity. Method: A 12-item CMSAS was developed by in-depth interview and item analysis. The scale was validated with a sample of 627 Chinese…

Two versions of a general method for approximating standard error of regression effect estimates within an IRT-based latent regression model are compared. The general method is based on Binder's (1983) approach, accounting for complex samples and finite populations by Taylor series linearization. In contrast, the current National Assessment of…

In the field of EFL, effective language evaluation is receiving more and more attention. However, in many Chinese EFL situations, the evaluation of language development is still considered to be product-oriented. It is the purpose of this article to examine an evaluation system of an English language program offered by a university in Yunnan…

This is a preliminary study that examines prospective teachers' reflective thinking as it is exhibited in their action research during the teaching practice experience. Different systems of analyzing reflective thinking are reviewed and criticized for their suitability for analyzing written journals rather than other forms of expressing and…