The ability estimation procedure is one of the most important components in a computerized adaptive testing (CAT) system. Currently, all CATs that provide K-12 student scores are based on the item response theory (IRT) model(s); while such application directly violates the assumption of independent sample of a person in IRT models because ability…

Test-based e-Assessment approaches are mostly focused on the assessment of knowledge and not on that of other skills, which could be supported by multimedia interactive services. This paper presents the QTIMaps model, which combines the IMS QTI standard with web maps services enabling the computational assessment of geographical skills. We…

In the task switch paradigm, a switch of task is typically accompanied by a change in task cue. It has been proposed that the performance deficit usually observed when switching tasks is actually the result of changing cues. To test this possibility, we used a 2:2 cue-task mapping in which each cue indicated 2 different tasks. With advance…

Assessment is an important cornerstone of education. A world trend in staying abreast of the latest developments in the field of information and communication technology (ICT) has led to an increased demand for electronic assessment in education circles. The critical need and responsibility for higher education to stay on par with the latest…

In automated test assembly (ATA), the methodology of mixed-integer programming is used to select test items from an item bank to meet the specifications for a desired test form and optimize its measurement accuracy. The same methodology can be used to automate the formatting of the set of selected items into the actual test form. Three different…

This paper proposes two new item selection methods for cognitive diagnostic computerized adaptive testing: the restrictive progressive method and the restrictive threshold method. They are built upon the posterior weighted Kullback-Leibler (KL) information index but include additional stochastic components either in the item selection index or in…

In most medical schools, summative practical examination in Anatomy usually takes the format of a "steeplechase" ("spotters" or "bell ringers") conducted in the gross anatomy laboratory using cadaveric material and prosected specimens. Recently, we have started to administer similar examinations online using the quiz…

Between 2002 and 2014, the Institute of Education Sciences (Institute) supported over 400 projects focused on education technology through the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER). The majority of this work has been funded through Education Technology research topics of NCER…

The Every Student Succeeds Act (ESSA) opened up new possibilities for how student and school success are defined and supported in American public education. States have greater responsibility for designing and building their assessment and accountability systems. These new opportunities to develop performance assessments are critically important…

This article deals with the integrated use of online quizzes as a teaching and assessment tool in the general program of the subject Proyectos in the third course of Ingeniero Técnico en Informática de Gestión over five consecutive years. The research undertaken aimed to test quizzes effectiveness on student performance when used, not only as an…

A rapidly expanding arena for item response theory (IRT) is in attitudinal and health-outcomes survey applications, often with polytomous items. In particular, there is interest in computer adaptive testing (CAT). Meeting model assumptions is necessary to realize the benefits of IRT in this setting, however. Although initial investigations of…

Identification of the second of two targets (T2) is impaired when presented shortly after the first (T1). This "attentional blink" (AB) is thought to arise from a delay in T2 processing during which T2 is vulnerable to masking. Conventional studies have measured T2 accuracy which is constrained by the 100% ceiling. We avoided this problem by using…

Affective feedback during a self-assessment test could help induce the learner to an optimal emotional state regarding the learning material. However, there is a lack of experimental evidence concerning the influence of affective feedback during a self-assessment test. This paper is a step towards this direction. The effect of achievement-based…

Neil Dorans has made a career of advocating for the examinee. He continues to do so in his NCME career award address, providing a thought-provoking commentary on some current trends in educational measurement that could potentially affect the integrity of test scores. Concerns expressed in the address call attention to a conundrum that faces…

A Massive Open Online Course (MOOC) is a model for delivering learning content online to any person who wants to take a course, with no limit on attendance. The MOOC industry is growing rapidly, fueled by students interested in free higher-education learning, and the universities and venture capitalists willing to fund the courses. This paper…