In this technical report, we describe the development and piloting of a series of mathematics progress monitoring measures intended for use with students in kindergarten. These measures, available as part of easyCBM[TM], an online progress monitoring assessment system, were developed in 2008 and administered to approximately 2800 students from…

The purpose of this study is to investigate the effectiveness of response modes by item and feedback type in a web-based language learning program. The subjects of this study, 122 Korean tenth graders learning English as a foreign language, were placed into groups of four and were given a web-based language learning program consisting of two…

Computer aided assessment is a common approach used by educational institutions. The benefits range into the design of teaching, learning, and instructional materials. While some such systems implement fully automated marking for multiple choice questions and fill-in-the-blanks, they are insufficient when human critiquing is required. Current…

Because there is no commonly accepted view of what makes for good writing, automated essay scoring (AES) ideally should be able to accommodate different theoretical positions, certainly at the level of state standards but also perhaps among teachers at the classroom level. This paper presents a practical approach and an interactive computer…

Since 1989, the Mathematics Education Project (PmatE--Projecto Matematica Ensino) has developed several strategies to improve the success of students in Mathematics. The most important of these are mathematical games for all grades above primary school. The online evaluation of Mathematics subjects is one of PmatE's goals. The implementation of an…

This study elaborates the "what works?" question by exploring the effects of variability in program implementation quality on achievement. Particularly, the effects on achievement of computerized assessment of reading were investigated, analyzing data on 51,000 students in Grades 1-12 who read over 3 million books. When minimum implementation…

This comparative study examined the degree of similarity between the results of the Self-Directed Search and an online career assessment. Implications for career counselors, based on the results, are briefly discussed.

The ways in which experience and academic training influence the types of questions therapists ask of their clients were studied. Psychologists and psychology students of varying degrees of expertise (n=138) were provided an artificial intelligence program that simulated a date rape client's responses to typed questions and were asked to conduct a…

In this study, the relationships between simple learning by accretion and various cognitive ability variables were explored. Computerized tests of five sources of individual differences were administered to a sample of 714 Air Force recruits, along with a trigram-English word paired-associate task, which was presented as a foreign language…

This paper presents a study on the generation of mathematics test items using algorithmic methods. The history of this approach is briefly reviewed and is followed by a survey of the research to date on the statistical parallelism of algorithmically generated mathematics items. Results are presented for 8 parallel test forms generated using 16…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Recent years have seen widespread adoption of automatic grading of physics homework problems. Although first-generation homework management systems provide feedback and assign scores based only on the answers, problem-solving performance on exams seems to be no worse for students using these systems than for those who receive detailed comments…

Linear programming models with 0-1 variables are useful for the construction of tests from an item bank. Most solution strategies for these models start with solving the relaxed 0-1 linear programming model, allowing the 0-1 variables to take on values between 0 and 1. Then, a 0-1 solution is found by just rounding, optimal rounding, or a…

Testing 1-2-3 is a general purpose testing system developed at the Computer-Based Education Research Laboratory at the University of Illinois for use on NovaNET computer-based education systems. The testing system can be used for: short, teacher-made quizzes, individualized examinations, computer managed instruction curriculum testing,…

This manual describes and explains the commands available in the ITEMBANK package (a comprehensive test item bank). True-false, multiple-choice, short-answer, and essay items, as well as the associated answers, can be accommodated. Content domains and behavior categories exist for item classification. Most menus have instant action. Items and…