This article describes an empirical investigation of whether performance on a senior-level assessment of methodological and statistical knowledge was related to elapsed time since students took prerequisite methods and statistics courses. In a senior-capstone course, 50 students completed a 50-item multiple-choice assessment measuring their…

We investigated the use of quizzes administered prior to lecture (i.e., prelecture quizzes) and compared them to no-quiz control groups. In previous research, the success of administering quizzes after covering a topic (i.e., postlecture quizzes) was contingent on the quizzes and the subsequent exams being of similar level and content. However,…

The purpose of the study was to establish a relationship between the shift of meaning of the concept oxidation that has taken place during the historical development, and students' alternative concepts. First Examination Board papers were examined. The result enabled us to specify the research question. In the main part of the study,…

On 4 of 7 days in each unit of an undergraduate human development course, students responded in writing to specific questions related to instructor notes previously made available to them. The study compared the effects of three writing contingencies on the quality of student writing and performance on major multiple-choice exams in the course. …

The present studies were undertaken to examine the effects of manipulating delay-interval task (Study 1) and timing of feedback (Study 2) on acquisition and retention. Participants completed a 100-item cumulative final examination, which included 50 items from each laboratory examination, plus 50 entirely new items. Acquisition and retention were…

Despite the prevalence of multiple choice items in educational testing, there is a dearth of empirical evidence for multiple choice item writing rules. The purpose of this study was to expand the base of empirical evidence by examining the use of the "all-of-the-above" option in a multiple choice examination in order to assess how…

Do students change as a result of completing their general education requirement? This question was examined by using a pretest/posttest design with five different cohorts of students required to complete a general education program in American history and politics. Differences among various groups in Cohen's d (the standardized difference between…

This research concerns the development and assessment of a program of introductory astronomy conceptual exercises called ranking tasks. These exercises were designed based on results from science education research, learning theory, and classroom pilot studies. The investigation involved a single-group repeated measures experiment across eight key…

The study evaluated the comparability of two versions of a certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). An effect size measure known as Cohen's d and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that the effect…

In U.S. schools, students must pass statewide competency tests to graduate from high school. In this article, the authors summarize the development and testing of a program implemented to improve the skills of students failing to "make the grade" on these high-stakes tests. District personnel randomly assigned twenty-eight students who…

In traditional Chinese medicine, a key maxim is "Zhi Bing Yao Zhi Gen," which literally means, "To cure a disease one must cure the underlying cause." The author was reminded of this principle when she reflects on K-12 math education reform when the US. President Bush's 2006 State of the Union Address prompted yet another wave…

This dissertation sought to answer the question: Is it possible to build a software tool that will allow teachers to write better multiple-choice questions? The thesis proceeded from the finding that the quality of teaching is very influential in the amount that students learn. A basic premise of this research, then, is that improving teachers…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

Twenty-four students who scored 650 or more on the Scholastic Aptitude Test Mathematics test (SAT-M) were asked to think aloud while solving 13 mathematics items in either multiple-choice or free-response format. Strategies students used to solve the items were classified as either algorithmic or insightful. Data analyses indicated that items in…

The relationship between the multiple-choice and free-response sections of the Computer Science and Chemistry tests of the College Board's Advanced Placement program was studied. Confirmatory factor analysis showed that the free-response sections measure the same underlying proficiency as the multiple-choice sections for the most part. However,…