This paper outlines an approach taken to produce computer-based formative assessments for two modules in a one-year taught MSc programme in Road Management and Engineering. It presents the aims of the assessments, the taxonomy adopted to ensure that the formulation of the questions addressed learning outcomes related to the development of higher…

Classification studies are important for practitioners who need to identify individuals for specialized treatment or intervention. When interventions are irreversible or misclassifications are costly, information about the proficiency of different classification procedures becomes invaluable. This study furnishes information about the relative…

Many educators and researchers are trying to define statistical literacy for the 21st century. Kimura, a Japanese science educator, has suggested that a key task of statistical literacy is the ability to extract qualitative information from quantitative information, and/or to create new information from qualitative and quantitative information.…

Comments on an article by Macy et al. The authors supports the potential use of the Assessment, Evaluation and Programming System for Infants and Children (AEPS:E) as an instrument for determining eligibility with toddler-aged children (18 to 36 months). Much work remains to be done before the AEPS:E should be recommended for use in determining…

The present study focuses on the task characteristics of reading passages and key sentences in a test of second language reading. Using a new methodological approach to describe variation in test task characteristics and explore how differences in these characteristics might relate to examinee performance, it posed the two following research…

Student dissatisfaction concerning education has been an issue for decades. A 1972 investigation into the thinking of youth found that respondents were neither satisfied nor confident regarding the situation they faced and were pessimistic about the future. The primary purpose of the study reported in this paper was to examine whether students in…

The study evaluated the invariance of the construct validity and thus the interpretation of Graduate Record Examinations (GRE) Aptitude Test scores. A systematic procedure for investigation of test bias from a construct validity frame of reference was developed and applied. Invariant construct validity was defined as similar patterns of loadings…

The study evaluated the comparability of two versions of a teacher certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). Standardized mean difference (SMD) and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that effect sizes…

The study compared two promising item response theory (IRT) item-selection methods, optimal and content-optimal, with two non-IRT item selection methods, random and classical, for use in fixed-length certification exams. The four methods were used to construct 20-item exams from a pool of approximately 250 items taken from a 1985 certification…

The Vocational Interest Survey (VIS) is a set of six questionnaire scales for measuring vocational interest. It is designed for Australian users and is consistent with Holland's theory that there are six basic career categories. This paper discusses the development of the VIS and presents some technical data on the questionnaires. Items were…

This paper describes a computer program in Microsoft BASIC which selects and administers test items from a small item bank. The level of the difficulty of the item selected depends on the test taker's previous response. This adaptive system is based on the Rasch model. The Rasch model uses a unit of measurement based on the logarithm of the…

A multiple choice achievement test was constructed in which both cognitive level and degree of abstractness were controlled. Subjects were 75 students from a major university in the Southwest. A group of 13 judges, also university students, classified the concepts for degree of abstractness. Results indicated that both cognitive level and degree…

In some testing programs an early item analysis is performed before final scoring in order to validate the intended keys. As a result, some items which are flawed and do not discriminate well may be keyed so as to give credit to examinees no matter which answer was chosen. This is referred to as allkeying. This research examined how varying the…

Item analysis data fitting the normal ogive model were simulated in order to investigate the problems encountered when applying the three-parameter logistic model. Binary item tests containing 10 and 35 items were created, and Monte Carlo methods simulated the responses of 2,000 and 500 examinees. Item parameters were obtained using Logist 5.…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…