Biology instructors use concept assessments in their courses to gauge student understanding of important disciplinary ideas. Instructors can choose to administer concept assessments based on participation (i.e., lower stakes) or the correctness of responses (i.e., higher stakes), and students can complete the assessment in an in-class or…

We developed the Physics Inventory of Quantitative Literacy (PIQL) to assess students' quantitative reasoning in introductory physics contexts. The PIQL includes several "multiple-choice-multipleresponse" (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) as well as traditional single-response…

The National Assessment of Educational Progress (NAEP) -- often called "The Nation's Report Card" -- is the largest nationally representative and continuing assessment of what students in public and private schools in the United States know and can do in various subjects and has provided policy makers and the public with invaluable…

An IRT-based sequential procedure is developed to monitor items for enhancing test security. The procedure uses a series of statistical hypothesis tests to examine whether the statistical characteristics of each item under inspection have changed significantly during CAT administration. This procedure is compared with a previously developed…

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

This study investigated the responses of 531 preservice teachers to a "Beliefs About Assessment" questionnaire in China. The questionnaire focused on understanding the purposes, practices and principles of assessment for and of learning. Using factor analysis, an inter-correlated two-order model fitted well to the responses. This model…

Objective: Examine the validity of a self-report measure of eating competence with low-income women. Methods: Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of…

Background: From the perspective of self-regulated learning, the interplay between learners' individual characteristics and the context of testing have been emphasized for assessing learning outcomes. Aims: The present study examined metacognitive processes in children's test-taking behaviour and explored their impacts on performance. Further, it…

The study discussed the importance of test validity, often established when making decisions that may affect a student's future. The decisions made by policymakers and educators must not adversely affect any particular subgroups of students (i.e., year of administration, gender, ethnicity, level English proficiency, socioeconomic status, and…

This comprehensive "Handbook" focuses on the most used polytomous item response theory (IRT) models. These models help us understand the interaction between examinees and test questions where the questions have various response categories. The book reviews all of the major models and includes discussions about how and where the models…

Three methods of detecting item drift were compared: the procedure in BILOG-MG for estimating linear trends in item difficulty, the CUSUM procedure that Veerkamp and Glas (2000) used to detect trends in difficulty or discrimination, and a modification of Kim, Cohen, and Park's (1995) x 2 test for multiple-group differential item functioning (DIF),…

Testing is essential in education and other social science fields because many assessments, decisions, and policies are made according to the results of testing. The purpose of testing is to estimate a person's ability, that is, latent trait or construct. In a test setting, responses to a set of test items by each individual are recorded. Through…

It is concluded that conditional reasoning performance is not influenced by subjects' familarity content in the premises. (Author)

It is sometimes desirable to obtain an estimated total-test score for an individual who was administered only a subset of the items in a total test. The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students in grades 3-5 and 60 items of the ll0-item Stanford Mental…