This study examined performance of a simulated computerized adaptive test that was designed to help direct the development of a medical recertification examination. The item pool consisted of 229 single-best-answer items from a random sample of 3,000 examinees, calibrated using the two-parameter logistic model. Examinees' responses were known. For…

A predictive adaptive testing (PAT) strategy was developed based on statistical predictive analysis, and its feasibility was studied by comparing PAT performance to those of the Flexilevel, Bayesian modal, and expected a posteriori (EAP) strategies in a simulated environment. The proposed adaptive test is based on the idea of using item difficulty…

This study examined whether an expert system approach involving intelligent selection of items (EXSPRT-I) is as efficient as item response theory (IRT) based three-parameter adaptive mastery testing (AMT) when there are enough subjects to estimate the three IRT item parameters for all items in the test and when subjects in the item parameter…

This study investigated the construct validity of the revised Special Education-Mental Handicaps Georgia Teacher Certification Test (MH-TCT) using hierarchical confirmatory factor analysis and LISREL VI. The primary objective was to determine whether first-order and second-order factors correspond to item/objective/test relationships defined by…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

Arima's Discrimination Learning Test (DLT) was reconfigured, made into a self-paced mode, and administered to potential recruits in order to determine if: (1) a previous study indicating a lack of difference in learning performance between white and nonwhites would hold up; and (2) the correlations between scores attained on the DLT and scores…

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

Part 1 of this document describes the background, format, and early groundwork that went into the development of a test sponsored entirely by private enterprise. The discipline imposed by a financial bottom line imposes special pressures but also offers new opportunities. This private enterprise model is a multi-constructional process where…

Examinees in a regular administration of the quantitative portion of the Graduate Record Examination responded to particular items in a machine-scannable multiple-choice format. Volunteers (n=364) used a computer to answer open-ended counterparts of these items. Scores for both formats demonstrated similar correlational patterns. (SLD)

E-rater[R] has been used by the Educational Testing Service for automated essay scoring since 1999. This paper describes a new version of e-rater (V.2) that is different from other automated essay scoring systems in several important respects. The main innovations of e-rater V.2 are a small, intuitive, and meaningful set of features used for…

To assess students' business writing abilities upon entry into the business program and exit from the capstone course, a multitiered assessment package was developed that measures students' achievement of specific learning outcomes and provides "value-added" scores. The online segment of the test measures five competencies across three process…

The fast development of information and communication technologies (ICT) improves greatly education quality. E-learning is an important education component at Zagreb School of Economics and Management (ZSEM) and, in addition, it is obligatory for all our teachers and students. In this paper, the development process of course "Sociology"…

Published papers on the area of online assessment have mainly focused on instructors' assessment of online discussion forums or computer-assisted testing in a highly structured environment with a narrow focus on multiple choice or true-false types of questions. With the exponential growth of online courses and many educational institutions looking…

Providing fair assessment with timely feedback for students is a difficult task with science laboratory classes containing large numbers of students. Throughout our Faculty, such classes are assessed by short-answer questions (SAQs) centred on principles encountered in the laboratory. We have shown recently that computer-assisted assessment (CAA)…

The rapid growth of online learning has led to the development of staff inservice evaluation models that are geared towards improving degree programs. Based on best practices in student online assessment, the Online Faculty Development and Classroom Learning Environment Assessment course was designed to serve the dual purpose of staff development…