With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and…

In contrast to simple feedback, which provides students with the correct answer, elaborated feedback provides an explanation of the correct answer with respect to the student's error. Elaborated feedback is thus a challenge for AI in education systems because it requires dynamic explanations, which traditionally require logical reasoning and…

In an upcoming coverage-comprehension study, we plan to assess learners' meaning-recall knowledge of words as they occur in the study's reading passage. As several meaning-recall test formats exist, the purpose of this small-scale study (N = 10) was to determine which of three formats was most similar to a criterion interview regarding mean score…

Metacognition has increasingly been recognized as essential for learning. This paper defines metacognition, discusses its importance, and specifies how faculty can nurture it in students to promote positive learning outcomes. The paper then offers extensive examples based on two formats: (1) activities offered before, during, and after lessons or…

Reading comprehension tests are often assumed to measure the same, or at least similar, constructs. Yet, reading is not a single but a multidimensional form of processing, which means that variations in terms of reading material and item design may emphasize one aspect of the construct at the cost of another. The educational systems in Denmark,…

The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

People of Hispanic origin, including monolingual Spanish speakers, have experienced difficulty identifying with a race category on U.S. demographic surveys. As part of a larger research effort by the U.S. Census Bureau to improve race and Hispanic origin questions for the 2020 Census, we tested experimental versions of race and Hispanic origin…

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…

The purpose of this handbook is to acquaint principals and teachers with the California Achievement Tests, mandated by the Maryland State Department of Education. Reports of the test results are also discussed. The first chapter describes the test and provides examples of question formats. A table of the objectives measured is also included. The…

A study was conducted to compare the results of three test formats in relation to assessing the depth of vocabulary knowledge of fourth-grade students. Students (117) were tested on their knowledge of the primary and secondary meanings of 44 multimeaning words using multiple-choice, yes/no, and interview formats. Information on the test-taking…

Item overlap coefficient (IOC) formulas are discussed, providing six warnings about their calculation and interpretation and some explanations of why item overlap influences the Minnesota Multiphasic Personality Inventory and the Millon Clinical Multiaxial Inventory factor structures. (SLD)

Provides a framework for understanding the concept of validity and how it applies to simulation research. Extant tests of validity are discussed in terms of this framework, and a general schema for testing validity is proposed. (MBR)

Reflecting the ideas of many diverse individuals and organizations involved in reading education, this booklet presents Reading Framework for the 2003 National Assessment of Educational Progress (NAEP), which provides the guidelines and theoretical basis for the 1992-2003 reading assessments. The first chapter, What Is the NAEP Reading…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

Many state and local entities are developing and using performance assessment programs. Because these initiatives are so diverse, it is very difficult to understand what they are doing, or to compare them in any meaningful way. Multiple-choice tests are contrasted with performance assessments, and preliminary classifications are suggested to…