Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC items leads to differences in the strategy…

In an effort to better align item development to goals of assessing higher-order tasks and decision making, complex decision trees were developed to follow clinical reasoning scripts and used as models on which multiple-choice questions could be built. This approach is compatible with best-practice assessment frameworks like Evidence Centered…

This study investigates how factors such as student achievement goals for a course, language skills, outside work commitments, and test anxiety are related to performance on multiple-choice exams and nonexam assignments. The study also explores whether these factors explain the time taken to complete exams and whether exam completion speed is…

Observational tutoring has been found to be an effective method for teaching a variety of subjects by reusing dialogue from previous successful tutoring sessions. While it has been shown content can be learned through observational tutoring, it has yet to been examined if a secondary behavior such as goal setting can be influenced. The present…

Providing two or more versions of multiple-choice exams has long been a popular strategy for reducing the opportunity for students to engage in academic dishonesty. While the results of studies comparing exam scores under different question-order conditions have been inconclusive, the potential importance of contextual cues to aid student recall…

Learning progressions (LPs) are hypothetical models of how learning in a domain develops over time with appropriate instruction. In the domain of genetics, there are two independently developed alternative LPs. The main difference between the two progressions hinges on their assumptions regarding the accessibility of classical (Mendelian) versus…

This study examines the effects of an electronic reading environment's structure on second language (L2) reading comprehension. In particular, this study explores whether clarifying the underlying structure of an electronic text, along with the ways in which its units or nodes are organized and interrelated results in better comprehension as well…

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…

Energy is a critically important topic in the K-12 science curriculum, with many applications in the earth, physical, and life sciences and in engineering and technology. To meet the challenges associated with teaching energy, new tools and assessment instruments are needed. In this work we describe the development of a three-tier assessment…

Testwiseness--that is, the ability to find subtle cues towards the solution by the simultaneous comparison of the available answer options--threatens the validity of multiple-choice (MC) tests. Discrete-option multiple-choice (DOMC) has recently been proposed as a computerized alternative testing format for MC tests, and presumably allows for a…

Taking a test generally improves the retention of the material tested. This is a phenomenon commonly referred to as testing effect. The present research investigated whether two-tier diagnostic tests promoted student teachers' conceptual understanding of variables in conducting scientific experiments, which is a scientific process skill. In this…

This paper reports part of an ongoing investigation into aspects of pre-service teachers' geometric knowledge. One hundred and fifty-two Australian pre-service teachers responded to a series of questions that reflect the type of knowledge teachers are expected to know and teach. Analysis of their responses shows that teacher knowledge can be…

Leading scholars (Gilbert, 2009; Walter, 2008) have highlighted the importance of phonological processing in learning to read. Nevertheless, reading in Japan has traditionally been taught without adequate attention to the role of phonological processing. Accordingly, it was speculated that Japanese university students would demonstrate superior…

The sociopolitical and economic structure of Nigeria is being threatened by youth incivility, while civic virtues in all spheres of life are gradually declining. This study examined the effects of the 5Es instructional strategy on the literacy scores of students in Civic Education. A research question was raised with the corresponding hypothesis.…