Multiple-choice exams are frequently used as an efficient and objective method to assess learning, but they are more vulnerable to answer copying than tests based on open questions. Several statistical tests (known as indices in the literature) have been proposed to detect cheating; however, to the best of our knowledge, they all lack mathematical…

The "gender gap" on various physics conceptual evaluations has been extensively studied. Men's average pretest scores on the Force Concept Inventory and Force and Motion Conceptual Evaluation are 13% higher than women's, and post-test scores are on average 12% higher than women's. This study analyzed the gender differences within the…

Do multiple choice unit tests reflect what students have learned during the unit? The day before the administration of a county-mandated multiple choice test, two classes were shown a topic they had not previously seen, and told it would be on the test. One class was shown the same material and told it was not important, and two classes were not…

The present study has two aims. Firstly, it aims to determine eighth grade students' conceptual understanding of floating and sinking through formative assessment probes. Secondly, it aims to determine whether or not there is a significant difference between students' performance in formative assessment probes and their achievement in the…

The present study has two aims. Firstly, it aims to determine eighth grade students' conceptual understanding of floating and sinking through formative assessment probes. Secondly, it aims to determine whether or not there is a significant difference between students' performance in formative assessment probes and their achievement in the…

Previous research on the impact of text and formatting changes on test-item performance has produced mixed results. This matter is important because it is generally acknowledged that "any" change to an item requires that it be recalibrated. The present study investigated the effects of seven classes of stylistic changes on item…

The purpose of this study was to compare the effectiveness of the lecture and discussion teaching methods and digital game-based learning on student achievement in agriculture and mathematics regarding a unit on swine diseases in animal science courses offered through secondary agricultural education programs in Oklahoma. Three research questions…

In this technical report, we present the results of a reliability study of the second-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

The purpose of this study was to explore the impact of the Problem Based Learning (PBL) units developed by a large suburban school district in the mid-Atlantic for the middle school gifted science curriculum on: a) students' performance on standardized tests in middle school Science, as measured by a sample of relevant test questions from a…

In this technical report, we present the results of a reliability study of the seventh-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

The study takes a close look at relationships between scores on a Mathematics standardized test in two different testing formats--Multiple-Choice (MC) and Constructed Response (CR). Many studies have been dedicated to finding correlations between item format characteristics with regards to race and gender. Few studies, however, have attempted to…

The population sensitivity of vertical scaling results was evaluated for a state reading assessment spanning grades 3-10 and a state mathematics test spanning grades 3-8. Subpopulations considered included males and females. The 3-parameter logistic model was used to calibrate math and reading items and a common item design was used to construct…

This investigation focused on a group of 17 faculty drawn from disciplines in the humanities social sciences and natural sciences. Using in-depth interviews, focus group discussions and qualitative coding strategies, this study examined how faculty conceptualized the term critical thinking (CT), and how they assessed for it in general education…

Although much is known about how students perform on standardized tests, little research exists concerning how students think and process while taking such tests. This mixed methods action research study was designed to investigate if a constructivist approach to test preparation could yield improved results for 37 English language arts freshmen…

This study investigated the feasibility of using the ordering theoretic procedure with multiple choice items, and its usefulness as an interpretive aid for intelligence test data. Data from two components of a group-administered multiple choice intelligence test (Otis-Lennon Mental Ability Tests) were analyzed using ordering theory procedure for…