The XX IDEA annual conference has been focused and reflected on different ways and means of meeting various kinds of methodological challenges, new technologies and multi-media developments, newly emerging partnerships and collaboration between emerging sectors on one hand and between the institutions functioning with similar objectives and…

This experiment involved college students (N = 464) working on an authentic learning task (writing an essay) under 3 conditions: no feedback, detailed feedback (perceived by participants to be provided by the course instructor), and detailed feedback (perceived by participants to be computer generated). Additionally, conditions were crossed with 2…

The General Computer Adaptive Test (CAT) of the Graduate Record Examinations (GRE) includes three operational sections that are separately timed and scored. A "no score" is reported if the examinee answers fewer than 80% of the items or if the examinee does not answer all of the items and leaves the section before time expires. The 80%…

In self-adapted testing (SAT), examinees select the difficulty level of items administered. This study investigated three variations of prior information provided when taking an SAT: (1) no information (examinees selected item difficulty levels without prior information); (2) view (examinees inspected a typical item from each difficulty level…

This research aimed to investigate the effect of computers on the test and inter-rater reliability of writing test scores of ESL learners. Writing samples of 20 pen-paper and 20 computer group students were scored in analytic scoring method by two scorers, and then the scores were analyzed in Alpha (Cronbach) model. The results showed that the…

The resurgence of testing and the significance of this trend to learning assistance facilitators and developmental educators are discussed. This increase in testing, particularly as it manifests itself on college and university campuses, reflects a shift of emphasis in testing, from measuring aptitude to measuring the effect of instruction.…

With the goal of improving the reliability and validity of tests of English as a foreign language, in particular with respect to the question of whether to allow notetaking on EFL/ESL computer-based listening comprehension tests, the present study examined the effects on ESL listening comprehension of notetaking (allowed or disallowed) in relation…

The development of a computer self-test program in geology at Macalester College, Minnesota, is described. Based on the philosophy that tests, particularly those involving no grading, are useful study devices, computers are used to make tests available to students. Ten lessons have been developed on different topics in geology, and the computer…

The comparability of computerized and paper-and-pencil tests was examined from cognitive perspective, using verbal protocols rather than psychometric methods, as the primary mode of inquiry. Reading comprehension items from the Graduate Record Examinations were completed by 48 college juniors and seniors, half of whom took the computerized test…

The relationship of an expert-system-scored constrained free-response item type to multiple-choice and free-response items was studied using data for 614 students on the College Board's Advanced Placement Computer Science (APCS) Examination. Implications for testing and the APCS test are discussed. (SLD)

Reports a study of the administration mode, scores, and testing experiences of students taking the PreProfessional Skills Test (PPST) under differing conditions (computer based and paper and pencil). PPST scores and surveys of the students revealed varied test-taking strategies and computer-related alterations in test difficulty, construct,…

No significant differences in performance on a self-adapted test or anxiety were found for college students (n=218) taking a self-adapted test who selected item difficulty without any prior information, inspected an item before selecting, or answered a typical item and received performance feedback. (SLD)

Implemented computerized adaptive testing (CAT) to measure students' attitudes toward alcohol. Administered a paper-and-pencil version and a CAT version of an attitudes toward alcohol scale to 113 undergraduates enrolled in health education classes. Findings showed a high correlation between scores from the CAT and the paper-and-pencil versions.…

Exploratory and confirmatory factor analyses were used to explore relationships among existing item types and three new computer-administered item types for the analytical scale of the Graduate Record Examination General Test. Results with 349 students indicate constructs the item types are measuring. (SLD)

Developed a computerized adaptive language proficiency test for a community college in Quebec, Canada and obtained item response theory calibrations on the items from 700 to 800 administrations. Describes projected efforts to detect instances in which "cheating low" (answering incorrectly deliberately) occurs. (SLD)