Online marking and feedback systems are critical for providing timely and accurate feedback to students and maintaining the integrity of results in large class teaching. Previous investigations have involved much in-house development and more consideration is needed for deploying or customising off the shelf solutions. Furthermore, keeping up to…

Although the term data-driven decision making (DDDM) is relatively new (Moss, 2007), the underlying concept of DDDM is not. For example, the practices of formative assessment and computer-managed instruction have historically involved the use of student performance data to guide what happens next in the instructional sequence (Morrison, Kemp, &…

This paper describes how a new "Moodle" module, called "CTPracticals", is applied to the teaching of the practical content of a basic computer organization course. In the core of the module, an automatic verification engine enables it to process the VHDL designs automatically as they are submitted. Moreover, a straightforward…

An applied Information Technology (IT) course that is assessed using pen and paper may sound incongruous but it is symptomatic of the state of high-stakes assessment in jurisdictions such as Western Australia. Whereas technology has permeated most aspects of modern life, including schooling, and more has been demanded of education systems in terms…

Many colleges and universities today are faced with the problem of low student academic achievement in math. Some of them are trying to improve student academic achievement through the use of technology. Their proposed solution is to teach children how to use the technological tools available to them and integrate that technology into the…

This article describes a comparative study conducted at the item level for paper and online administrations of a statewide high stakes assessment. The goal was to identify characteristics of items that may have contributed to mode effects. Item-level analyses compared two modes of the Texas Assessment of Knowledge and Skills (TAKS) for up to four…

External stakeholders and public constituents often have predetermined notions of what administrators do. This quantitative study was designed to help provide concrete evidence of how their time is actually spent. This researcher-developed survey was electronically sent to 332 secondary school principals in the state of Iowa. Although some…

The automated assembly of alternate test forms for online delivery provides an alternative to computer-administered, fixed test forms, or computerized-adaptive tests when a testing program migrates from paper/pencil testing to computer-based testing. The weighted deviations model (WDM) heuristic particularly promising for automated test assembly…

Effective observation and diagnosis of student learning can be greatly assisted by 21st century technologies. This article lists five practical tools to help educators measure student progress: (1) Clickers; (2) Online quizzes; (3) Web-based surveys; (4) Digital logs; and (5) Spreadsheets.

Computer adaptive testing systems are feasible for certification and licensure testing. This is in part due to the availability of extensive yet inexpensive computers. Modern item response theory, combined with computerized adaptive testing, yields a powerful new method of testing which provides greater accuracy and efficiency and less boredom for…

This paper presents the validation of an adaptive test developed for placement purposes in French at the post-secondary level, the French CAPT. Results from a second experiment are presented in which verbal protocols were obtained from nine college students of various levels with the thinking-aloud technique used during completion of the exam. The…

Computerized adaptive testing (CAT), while well-grounded in psychometric theory, has had few large-scale applications for high-stakes, secure tests in the past. This is now changing as the cost of computing has declined rapidly. As is always true where theory is translated into practice, many practical issues arise. This paper discusses a number…

According to item response theory (IRT), examinee ability estimation is independent of the particular set of test items administered from a calibrated pool. Although the most popular application of this feature of IRT is computerized adaptive (CA) testing, a recently proposed alternative is self-adapted (SA) testing, in which examinees choose the…

A study was conducted to validate the Army's Computerized Adaptive Screening Test (CAST), using data from 2,240 applicants from 60 army recruiting stations across the nation. CAST is a computer-assisted adaptive test used to predict performance on the Armed Forces Qualification Test (AFQT). AFQT scores are computed by adding four subtest scores of…

This paper discusses systemic problems with testing and outlines two scenarios for reformulating testing based on intelligent tutoring systems. Five desiderata are provided to underpin the type of testing proposed: (1) tests should emphasize learning and thinking; (2) tests should require generation as well as selection; (3) tests should be…