This study examines the stability of the "SAT Reasoning Test"™ score scales from 2005 to 2010. A 2005 old form (OF) was administered along with a 2010 new form (NF). A new conversion for OF was derived through direct equipercentile equating. A comparison of the newly derived and the original OF conversions showed that Critical Reading…

The mathematical knowledge for teaching (MKT) measures have become widely used among researchers both within and outside the U.S. Despite the apparent success, the MKT measures and underlying framework have been subject to criticism. The multiple-choice format of the items has been criticized, and some critics have suggested that opening up the…

During lectures, some students are continuously focused and attentive, whereas others tend to be bored, jittery, or inattentive. The same might happen when students are given student-activating assignments. Some students simply love one type of instruction, whereas others tend to resent it. Moreover, it is not the context itself, but the context…

In this paper, we present the results obtained using a clustering algorithm (Expectation-Maximization) on data collected from 106 college students learning about the circulatory system with MetaTutor, an agent-based Intelligent Tutoring System (ITS) designed to foster self-regulated learning (SRL). The three extracted clusters were validated and…

In this paper, the entries of Lang-8, which is a Social Networking Site (SNS) site for learning and practicing foreign languages, were analyzed and found to contain similar rates of errors for most error categories reported in previous research. These similarly rated errors were then processed using an algorithm to determine corrections suggested…

This Information Capsule reviews research conducted on computer-based assessments. Advantages and disadvantages associated with computer-based testing programs are summarized and research on the comparability of computer-based and paper-and-pencil assessments is reviewed. Overall, studies suggest that for most students, there are few if any…

Present large-scale assessments require the use of item formats, such as multiple choice, that can be administered and scored efficiently. This limits competencies that can be measured by these assessments. An alternative approach to large-scale assessments is being investigated that would include the use of complex performance assessments. As…

Multiple-choice testing is an educational reality. Rather than complain about the negative impact these tests may have on teaching and learning, why not use them to better understand your students' true mathematical knowledge and comprehension? Maryann Wickett and Eunice Hendrix-Martin show teachers how to move beyond the student's answer--right…

The Concise Data Processing Assessment (CDPA) was developed to probe student abilities related to the nature of measurement and uncertainty and to handling data. The diagnostic is a ten question, multiple-choice test that can be used as both a pre-test and post-test. A key component of the development process was interviews with students, which…

In this study, the effects of reflective self-explanations on conceptual understanding and problem solving are investigated in a domain of computer programming. After completing a multiple-choice test, 33 students were asked to reflect on and explain why their answers were correct or incorrect. Groups were divided for post hoc analysis based on…

The one-parameter logistic model with ability-based guessing (1PL-AG) has been recently developed to account for effect of ability on guessing behavior in multiple-choice items. In this study, the authors developed algorithms for computerized classification testing under the 1PL-AG and conducted a series of simulations to evaluate their…

The authors investigated whether the amount of instructional guidance affects science learning and self-efficacy. Sixty 9- and 10-year-old children were randomly assigned to one of the following three instructional conditions: (a) guided instruction consisting of examples and student-generated explanations, (b) direct instruction consisting of a…

Despite the extensive testing for federal accountability mandates, college students' understanding of federal accountability testing (e.g., No Child Left Behind, Race to the Top, Spellings) has not been examined, resulting in a lack of knowledge regarding how such understanding (or lack thereof) impacts college students' behavior on accountability…

Mixed-format assessments are increasingly being used in large scale standardized assessments to measure a continuum of skills ranging from basic recall to higher order thinking skills. These assessments are usually comprised of a combination of (a) multiple-choice items which can be efficiently scored, have stable psychometric properties, and…

In this technical report, we present the results of a reliability study of the sixth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…