Describes three technology-based alternative approaches to traditional classroom instruction that have been tried at Columbus State University (Georgia) to meet the needs of nontraditional part-time students: vendor-developed courses delivered via the internet; vendor-developed tutorials and tests on CD-ROM; and instructor-developed and…

Computerized-adaptive (CAT) and self-adapted (SAT) music listening tests were compared for efficiency, reliability, validity, and motivational benefits with 53 junior high school students. Results demonstrate trade-offs, with greater potential motivational benefits for SAT and greater efficiency for CAT. SAT elicited more favorable responses from…

This report provides a two-part evaluation of the IntelliMetric[SM] automated essay scoring system based on its performance scoring essays from the Analytic Writing Assessment of the Graduate Management Admission Test[TM] (GMAT[TM]). The IntelliMetric system performance is first compared to that of individual human raters, a Bayesian system…

Pressure for better measurement of stated learning outcomes has resulted in a demand for more frequent assessment. The resources available are seen to be static or dwindling, but Information and Communications Technology is seen to increase productivity by automating assessment tasks. This paper reviews computer-assisted assessment (CAA) and…

This study compares mean ratings, inter-rater reliabilities, and the factor structure of items for online and paper student-rating forms from the University of Washington's Instructional Assessment System. (Contains 3 figures and 2 tables.)

In this technical report, we describe the development and piloting of a series of mathematics progress monitoring measures intended for use with students in grades kindergarten through eighth grade. These measures, available as part of easyCBM[TM], an online progress monitoring assessment system, were developed in 2007 and 2008 and administered to…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

This paper describes a study in which a Picture Readability Index (PRI) was used to investigate initial and extended perceptions of photographs. Readability criteria for evaluating instructional text seems to have been in place for a long time, yet instructional visuals like photographs and illustrations have typically been subject to no such…

Methods of computerized adaptive testing using conventional scoring methods in order to develop a computerized placement test for the Test of English as a Foreign Language (TOEFL) were studied. As a consequence of simulation studies during the first phase of the study, the multilevel testing paradigm was adopted to produce three test levels…

Multilog (Thissen, 1991) was used to estimate parameters of 225 items from the Quebec Adaptive Behavior Scale (QABS). A database containing actual data from 2,439 subjects was used for the parameterization procedures. The two-parameter-logistic model was used in estimating item parameters and in the testing strategy. MicroCAT (Assessment Systems…

Two courses on logic gates were administered to 1,191 male and female recruits in Basic Military Training in 3 studies (448, 431, and 312 subjects, respectively) to evaluate the relative validities of the Armed Services Vocational Aptitude Battery (ASVAB) and the Learning Abilities Measurement Program (LAMP) tests in predicting individual…

In 1997, the Software Engineering Laboratory at Pontifical Catholic University of Rio de Janeiro (Brazil) implemented the first version of AulaNet (TM) a World Wide Web-based educational environment. Some of the teaching staff will use this environment in 1998 to offer regular term disciplines through the Web. This paper introduces Quest, a tool…

This paper describes a system that provides faculty with automatic testing and grading online facilities, as well as course administration resources, using the World Wide Web as a common and ubiquitous interface. The system was built using the Common Lisp HTTP Server from MIT and its functionality to generate HTML "on the fly," which offers the…

This guide is designed to enable the beginner, as well as the advanced user, to understand and use the Computerized Placement Management Software (CPMS). The CPMS is a system for evaluating information about students and recommending their placement into courses best suited for them. It also tracks their progress and maintains their records. The…

The issue of test-item selection in support of decision making in adaptive testing is considered. The number of items needed to make a decision is compared for two approaches: selecting items from an item pool that are most informative at the decision point or selecting items that are most informative at the examinee's ability level. The first…