Proposes a parametric approach that involves a modification of standard Item Response Theory models that explicitly accounts for the nesting of items within the same testlets and that can be applied to multiple-choice sections comprising a mixture of independent items and testlets. (Author/SLD)

Proposed and evaluated two new methods of improving the measurement precision of a general test factor. One provides a multidimensional item response theory estimate based on administrations of multiple-choice test items that span general and nuisance dimensions, and the other chooses items adaptively to maximize the precision of the general…

Discusses a simple modification to the method of answering and scoring multiple choice tests that allows students to indicate their estimates of the probability of the correctness of the multiple choice options for each question without affecting the validity of the assessment. (Author/CCM)

Under item response theory (IRT), linking proficiency scales from separate calibrations of multiple forms of a test to achieve a common scale is required in many applications. Four IRT linking methods including the mean/mean, mean/sigma, Haebara, and Stocking-Lord methods have been presented for use with single-format tests. This study extends the…

The misconceptions that students bring with them, or that arise during instruction, are a critical barrier to learning. Implicit-confidence tests, a simple modification of the multiple-choice test, can be used as a strategy for recognizing student misconceptions. An important issue, however, is whether such tests are gender-neutral. We analyzed…

In contemporary academic literature and in many national curricula, there is a widespread acceptance that critical thinking should be an important dimension of Education. Teachers and researchers recognize the importance of developing students critical thinking, but there are still great difficulties in defining and assessing critical-thinking…

Many psychology instructors present videotaped examples of behavior at least occasionally during their courses. However, few include video clips during examinations. We provide examples of video-based questions, offer guidelines for their use, and discuss their benefits and drawbacks. In addition, we provide empirical evidence to support the use…

In the present work, I investigated the origin of the misconception that glucose is the sole metabolic fuel previously described among Brazilian high school students. The results of a multiple-choice test composed of 24 questions about a broad range of biology subjects were analyzed. The test was part of a contest and was answered by a sample…

This study examined the effects of manipulating the modality (text-only, voice-only, voice+text) of a tutorial and restriction (restricted vs. unrestricted) of a simulation's interface on retention and transfer of tutorial content. The tutorial prepared novice students to use Packet Tracer, a simulation developed by Cisco that teaches network…

This study examined whether the design of textbook material affects comprehension and memory of textbook material under certain cognitive conditions for proficient and remedial readers. Using quantitative and qualitative research methods, format was found to significantly affect comprehension and memory. Proficient Male scored significantly…

This case study reports on the progress of Navon, a 13-year-old boy with prelingual deafness, over a 3-month period following exposure to Logo, a computer programming language that visualizes specific programming commands by means of a virtual drawing tool called the Turtle. Despite an almost complete lack of skills in spoken and sign language,…

The goals of our study were to determine the predictive value and usability of an audience response system (ARS) as a knowledge assessment tool in an undergraduate medical curriculum. Over a three year period (2006-2008), data were collected from first year didactic blocks in Genetics/Histology and Anatomy/Radiology (n = 42-50 per class). During…

In item-response theory, if a latent-structure model has an ability variable, then elementary information theory may be employed to provide a criterion for evaluation of the information the test provides concerning ability. This criterion may be considered even in cases in which the latent-structure model is not valid, although interpretation of…

The in house development of an online assessment tool, OASIS, has provided a unique opportunity to research the use of online assessment in teaching and learning across the university. The developing relationship between IT staff, educational designers and academics serves as a model for integrated and evolving management systems which demonstrate…

We determined the recommendations for preparing and scoring constructed-response (CR) test items in 25 sources (textbooks and chapters) on educational and psychological measurement. The project was similar to Haladyna's (2004) analysis for multiple-choice items. We identified 12 recommendations for preparing CR items given by multiple sources,…