Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

I administered quizzes to two sections of a course named "The Psychology of Learning." There were three multiple choice exams during the semester. Quizzes were given between exam 1 and exam 2. For one section, (lecture) quizzes occurred after the material had been covered in lecture. For the other section, quizzes were based on material not yet…

The first step in teaching-to-understand economics is not teaching "the rules," but working with fundamental economic models from the outset. Many of the concepts in economics are illustrated through models. Students must: (1) be able to draw these models; (2) understand the assumptions of the models; and (3) use the models for analysis.…

Student errors are springboards for analyzing, reasoning, and justifying. The mathematics education community recognizes the value of student errors, noting that "mistakes are seen not as dead ends but rather as potential avenues for learning." To induce specific errors and help students learn, choose tasks that might produce mistakes.…

We demonstrate that student engagement with PeerWise, an online tool that allows students to author and answer multiple-choice questions (MCQs), is associated with enhanced academic performance across diverse assessment types on a second year Genetics course. Benefits were consistent over three course deliveries, with differential benefits…

A virtual learning environment can engage university students in the learning process in ways that the traditional lectures and lab formats cannot. We present our virtual learning environment "StudentResearcher," which incorporates simulations, multiple-choice quizzes, video lectures, and gamification into a learning path for quantum…

The reading framework for the 2015 National Assessment of Educational Progress (NAEP) presents the assessment's conceptual base and discusses its content. The framework describes the types of texts and questions that should be included in the assessment, as well as how the questions should be designed and scored. This report provides highlights of…

Professors who teach introductory astronomy to students not majoring in science desire them to comprehend the concepts and theories that form the basis of the science. They are usually less concerned about the myriad of detailed facts and information that accompanies the science. As such, professors prefer to test the students for such…

Andersen (1995, 2002) proves a theorem relating variances of parameter estimates from samples and subsamples and shows its use as an adjunct to standard statistical analyses. The authors show an application where the theorem is central to the hypothesis tested, namely, whether random guessing to multiple choice items affects their estimates in the…

The Common Core State Standards (CCSS) provide teachers with the expectations and requirements that are meant to prepare K-12 students for college and the workforce (CCSSI 2010b). The Common Core State Standards for Mathematical Practice (SMPs) emphasize the development of skills and conceptual understanding for students to become proficient in…

Dueck recounts how, as a high school history teacher, he began to allow students to retake all or part of their end-of-unit tests. Influenced by the work of Rick Stiggins, Dueck prepared students for tests better by focusing on three questions Stiggins says students should be able to answer for themselves: Where am I going in this unit?, Where am…

The percentage of students choosing the correct answer (PSCA) on 17 multiple-choice algorithmic questions taken from general chemistry exams is analyzed. PSCAs for these questions varied from 47 to 93%, and a decrease of 4.5% in PSCA was observed with each additional step in the algorithm required for solving the problem (R[superscript 2] = 0.80).…

New assessments that measure deeper learning--whether students understand challenging content and are able to apply that knowledge to think critically, solve problems, communicate their understanding, and work with their peers--are essential if students are to develop the competencies they need to succeed in an increasingly complex world. Such…

General chemistry tests from the Examinations Institute of the Division of Chemical Education of the American Chemical Society have been analyzed to identify factors that may influence how individual test items perform. In this paper, issues of item order (position within a set of items that comprise a test) and answer order (position of correct…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in…