This paper re-considers the widespread use of value-added approaches to estimate school "effects", and shows the results to be very unstable over time. The paper uses as an example the contextualised value-added scores of all secondary schools in England. The study asks how many schools with at least 99% of their pupils included in the…

How to compute and report subscores for a test that was originally designed for reporting scores on a unidimensional scale has been a topic of interest in recent years. In the research reported here, we describe an application of multidimensional item response theory to identify a subscore structure in a test designed for reporting results using a…

Background: Working memory, the ability to store and process information, is strongly related to learning outcomes. Aims: The aim of the present study is to extend previous research on early learning and investigate the relationship between working memory, cognitive styles, and attainment in adolescents using both national curriculum tests and…

The purpose of the study was to investigate how different student characteristics such as gender influence grades. In order to answer these questions, multivariate techniques were used. The data derive from The Gothenburg Educational Longitudinal Database (GOLD), and the subjects were 99,070 ninth-grade students born in 1987. The analyses were…

The study examined variations in district performance in KCPE national examination in Kenya between 2001 and 2007. The individual change model revealed that district poverty rate was not a significant predictor of either the initial district performance (2001) or the rate of change over the seven-year period. The regional context of North Eastern…

This study explores the reported level of test-taking motivation and the relation between test-taking motivation and mathematics achievement in a sample of Swedish eighth-grade students (n = 343) participating in Trends in International Mathematics and Science Study (TIMSS) 2003. A majority of students reported that they were motivated to do their…

Chapter 1 examines the effects of college quality on students' learning, employment and earnings in Colombia. Scores on a national college "entry" test solely determine admission to many selective Colombian universities, creating exogenous peer and resource quality variation near admission cutoffs. In one regression discontinuity (RD)…

The use of microworlds (MWs), or complex dynamic systems, in educational testing and personnel selection is hampered by systematic measurement errors because these new and innovative item formats are not adequately controlled for their difficulty. This empirical study introduces a way to operationalize an MW's difficulty and demonstrates the…

This study aimed to provide evidence to guide decisions on the type and timing of assessments in a graduate medical programme, by identifying whether students from particular degree backgrounds face greater difficulty in satisfying the current assessment requirements. We examined the performance rank of students in three types of assessments and…

The present study investigates the use of English lexical collocations and their relation to the online writing of Taiwanese college English majors and non-English majors. Data for the study were collected from 41 English majors and 21 non-English majors at a national university of science and technology in southern Taiwan. Each student was asked…

Large scale testing in English affects second-language students not only greatly but also differently than first-language learners. The research literature reports that confounding factors in such large-scale testing such as varying test formats may differentially affect the performance of students from diverse backgrounds. An investigation of…

This work presents the analysis of the 2001 Brazilian Basic Education Evaluation System (SAEB) achievement exam. The SAEB tested 4th, 8th, and 11th grade students, in mathematics and reading (Portuguese). We classified the students into seven socioeconomic classes, and for each class, compared the test results according to frequency of computer…

In describing several pitfalls associated with research on school and teacher effectiveness, the following aspects of effectiveness research are considered: correlation-causation relationship, controlling for background factors, statistical and practical significance, instrumentation problems, regression effects, measurement of change, nonlinear…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

This article gives a description of three analyses concerning the construct learning to learn and the assessment of cross-curricular skills. First, the correspondence between learning to learn and cross-curricular skills is examined by means of a theoretical content analysis. Second, the nature of cross-curricular skills is studied through a…