This study explores six item-reduction methodologies used to shorten an existing complex problem-solving non-objective test by evaluating how each shortened form performs across three sources of validity evidence (i.e., test content, internal structure, and relationships with other variables). Two concerns prompted the development of the present…

New technology enables interactive and adaptive scenario-based tasks (SBTs) to be adopted in educational measurement. At the same time, it is a challenging problem to build appropriate psychometric models to analyze data collected from these tasks, due to the complexity of the data. This study focuses on process data collected from SBTs. We…

This dissertation examines the problem-solving processes of seven graduate student novices enrolled in a course in educational assessment and ten educational assessment experts. Using Jonassen's (1997) ill- and well-structured problem-solving frameworks, I analyze think-aloud protocols of experts and novices as they examine ill-structured…

Over the past decade there has been a major move to position "thinking" (however thinking is defined and enacted) as a more explicit outcome within the curriculum of many nations, with implications for teachers' professional development, assessment, and examination requirements. This paper analyses approaches to this challenge taken by…

Assessments and student expectations can drive learning: students selectively study and learn the content and skills they believe critical to passing an exam in a given subject. Evaluating the nature of assessments in undergraduate science education can, therefore, provide substantial insight into student learning. We characterized and compared…

In this study, the Canadian English and French versions of the Problem-Solving Measure of the Programme for International Student Assessment 2003 were examined to investigate their degree of measurement comparability at the item- and test-levels. Three methods of differential item functioning (DIF) were compared: parametric and nonparametric item…

Results from the Organisation for Economic Cooperation and Development's (OECD's) Programme for International Student Assessment (PISA) have shown that the degree to which education systems succeed in equipping students with important foundation skills varies significantly. Since the quality of teaching is at the heart of student learning…

Volume 1 of this sourcebook is a compendium of information about tests used to assess critical thinking, problem solving, and writing. It serves as a tool for people who want comparative data about the policy relevance of specific student outcomes measured in these areas. An interactive version of Volume 1 allows users to specify their areas of…

Needs assessment is a young and growing field. Needs assessments contribute to effective educational planning and help educators improve services to students. Needs assessment can be used to identify goals and objectives, but probably has the most utility as a problem-focusing strategy that includes the following sequence: (1) identification of…

The introductory chapter considers how the major education issues treated came to be defined and what operational processes were utilized to address the issues. Then, some observations and generalizations are made concerning the varying perspectives and approaches utilized by the authors in attacking the issues. To assist readers in relating to…

Many state and local entities are developing and using performance assessment programs. Because these initiatives are so diverse, it is very difficult to understand what they are doing, or to compare them in any meaningful way. Multiple-choice tests are contrasted with performance assessments, and preliminary classifications are suggested to…

Teachers College of Columbia University (New York) and the Dalton School, an independent school in New York City, have collaborated on the Dalton Technology Project and its "Archaeotype" program which presents students with a graphic simulation of an archeological site. Students simulate digging up the artifacts, use reference sources to…

One of the most ambitious attempts to assess students' understanding of mathematics was carried out in England between 1974 and 1979. The results of this study indicate that there is a need in an overall assessment program to evaluate students' algebraic understanding as well as to measure their achievement in algebraic manipulations and problem…

The Adult Literacy and Life Skills Survey (ALL) is a large-scale co-operative effort undertaken by governments, national statistics agencies, research institutions and multi-lateral agencies. The development and management of the study were co-ordinated by Statistics Canada and the Educational Testing Service (ETS) in collaboration with the…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…