We introduce a specific type of item for knowledge tests, confidence-weighted true-false (CTF) items, and review experiences of its application in psychology courses. A CTF item is a statement about the learning content to which students respond whether the statement is true or false, and they rate their confidence level. Previous studies using…

The National Assessment of Educational Progress (NAEP) is the only continuing and nationally representative measure of trends in academic achievement of U.S. elementary and secondary school students in various subjects. For more than four decades, NAEP assessments have been conducted periodically in reading, mathematics, science, writing, U.S.…

This study investigated the impact of electronic-based dynamic assessment on the listening skill of Iranian EFL learners to achieve this goal, a group of 40 female EFL upper-intermediate students (aged between 26 to 38 years old) from to language institutes were selected as the participants of the study after administering a Quick Placement Test…

We performed a survey of meta-analyses of test performance to describe the evolution in their methods and reporting. Studies were identified through MEDLINE (1966-2009), reference lists, and relevant reviews. We extracted information on clinical topics, literature review methods, quality assessment, and statistical analyses. We reviewed 760…

The purpose of this report is to review ETS psychometric contributions that focus on test scores. Two major sections review contributions based on assessing test scores' measurement characteristics and other contributions about using test scores as predictors in correlational and regression relationships. An additional section reviews additional…

Previous research has shown that repeated retrieval with written tests produces superior long-term retention compared to repeated study. However, the degree to which this increased retention transfers to clinical application has not been investigated. In addition, increased retention obtained through written testing has not been compared to other…

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary…

The purpose of the study was to examine the quality of open test questions directed to high school and college students. One thousand five hundred examination questions from various fields of study were examined using criteria based on the writing centers directions and guidelines. The 273 questions that did not fulfill the criteria were analyzed…

Modifying task presentation format and providing opportunities to choose are two effective procedures teachers can use to improve academic productivity for students with learning difficulties. Combining the two procedures may result in academic interventions that teachers can use without significantly changing the curriculum. The present study…

Background: The development of two-tier multiple-choice questions has permitted the diagnosis of students' understanding on various topics in the sciences as well as helped to ascertain the alternative conceptions they have. A limitation of two-tier diagnostic instruments that has been noted in the literature, but which has not been…

The purpose of test directions is to familiarize examinees with a test so that they respond to items in the manner intended. However, changes in educational measurement as well as the U.S. student population present new challenges to test directions and increase the impact that differential familiarity could have on the validity of test score…

The emergence of standards-based curriculums has resulted in an increased frequency of student testing, including high-stakes testing. Of students who take tests, up to 65% may experience test anxiety, which can have negative effects on student outcomes. For this reason, the purpose of this single-group, repeated measures design, quantitative…

This article describes a computerized adaptive test (CAT) based on the uniform item exposure multi-form structure (uMFS). The uMFS is a specialization of the multi-form structure (MFS) idea described by Armstrong, Jones, Berliner, and Pashley (1998). In an MFS CAT, the examinee first responds to a small fixed block of items. The items comprising…

Traditionally, an anatomy practical examination is conducted using a free response format (FRF). However, this format is resource-intensive, as it requires a relatively large time investment from anatomy course faculty in preparation and grading. Thus, several interventions have been reported where the response format was changed to a selected…

To help students gauge their understanding of basic concepts and encourage good study habits, we administered short online quizzes that use generic questions in the crucial first few weeks of a course. The purpose of the study was to investigate whether the combination of these web quizzes with generic questions with only binary feedback (right or…