The present paper questions the content validity of the eight creativity-related self-report scales available in PISA 2022's context questionnaire and provides a set of considerations for researchers interested in using these indexes. Specifically, we point out some threats to the content validity of these scales (e.g., "creative thinking…

Creativity tests, like creativity itself, vary widely in their structure and use. These differences include instructions, test duration, environments, prompt and response modalities, and the structure of test items. A key factor is task structure, referring to the specificity of the number of responses requested for a given prompt. Classic…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

Variation in test performance among examinees from different regions or national jurisdictions is often partially attributed to differences in the degree of content correspondence between local school or training program curricula, and the test of interest. This posited relationship between test-curriculum correspondence, or "alignment,"…

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

An analysis of data from the 1990 National Assessment of Educational Progress Trial State Assessment suggests that person-fit statistics may not provide additional information about results of psychometrically strong achievement tests. More research is needed before person-fit statistics can be used routinely in analysis of item response data.…

The purpose of this paper is to demonstrate how graphical analyses can enhance the interpretation and understanding of multidimensional item-response theory (IRT) analyses. Conceptually many of the unidimensional IRT concepts such as item characteristic curves, information, etc., can be extended to multiple dimensions. However, as the…

This paper presents six steps in test construction generally recommended by measurement textbook authors. The focus is primarily on paper-and-pencil achievement tests as used by class instructions, although the discussion touches on the construction of other types of assessment. The six steps are: (1) determine the test purpose; (2) determine the…

The current status of "homemade" achievement tests reported in "Journal of Research in Science Teaching" and "Science Education" (January 1975 to January 1980) is examined using Anderson's (EJ 062 750) eight categories of information that a high quality research report should include. Findings from 142 references…

Views teacher-made tests as a fundamental part of the educational process, defining instructional purposes, influencing what students study, and helping instructors gain perspective on their courses. Offers examples of test items that can perform these functions, while assessing knowledge and skills. (DMM)

This booklet is an explanation of what the Alaska High School Graduation Qualifying Examination means to Alaskans and how it fits into a larger school accountability reform initiative. The high school class of 2002 is the first group of students who will need to pass the High School Graduation Qualifying Examination to receive a high school…

Matches between questions in the Kentucky Instructional Results Information System for 1995-96 (KIRIS96), the Comprehensive Tests of Basic Skills, Fourth Edition (CTBS4), and the California Achievement Tests, Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are defined in the Kentucky curriculum framework were studied. Each…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA mathematics assessment. Following an overview of the PSSA, the second chapter focuses on the development and scoring of the mathematics assessment. Administering the assessment…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA writing assessment, which was designed to measure individual student performance and to influence instruction. The guide contains a chart of the Pennsylvania Academic Standards…

Studied whether student scores on standardized tests represent reasonable measures of instructional quality using ratings by 10 parents and 11 educators (school principals) of the degree to which test items from a nationally marketed standardized achievement test represent the content actually taught. On average, raters felt that test items…