Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by…

The current study compared student performance between paper-and-pencil testing (PPT) and computer-based testing (CBT) on a large-scale statewide end-of-course English examination. Analyses were conducted at both the item and test levels. The overall results suggest that scores obtained from PPT and CBT were comparable. However, at the content…

This study examined the degree of similarity between scores on the Self-Directed Search and an online instrument measuring Holland types. A relatively high congruency score was found between the two measures. Implications for career counselors are discussed.

The national certification tests and entrance examinations are the most important tests for proving the ability or knowledge level of a person. To accurately evaluate the professional skills or knowledge level, the composed test sheets must meet multiple assessment criteria such as the ratio of relevant concepts to be evaluated and the estimated…

A potential undesirable effect of multistage testing is differential speededness, which happens if some of the test takers run out of time because they receive subtests with items that are more time intensive than others. This article shows how a probabilistic response-time model can be used for estimating differences in time intensities and speed…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

This paper examines the Knowledge Age and how economic factors are causing educators to rethink and reinvent education. Two key factors in education in the Knowledge Age will be education for an economy of innovation, and the increasing virtualization of education. We present knowledge building pedagogy as a model for education in the Knowledge…

Computer-based testing, or e-assessment, has the potential to deliver immediate results for the benefit of schools. This paper describes a project that aimed to exploit this potential by designing e-assessments where the results were intended for use by teachers in planning the next steps in teaching and learning: low-stakes, formative assessment.…

This article details an investigation into the onscreen marking (OSM) of Liberal Studies (LS) in Hong Kong--where paper-based marking (PBM) of public examinations is being phased out and wholly superseded by OSM. The study involved 14 markers who had previously rated Liberal Studies scripts on screen in the 2009 Hong Kong Advanced Level…

As the technological age reaches its peak, so does the need to improve assessment for online instruction. Assessment includes all activities that teachers and students undertake to get information that can be used to improve teaching and learning (Black and William,1998b). Assessment is a critical factor of the learning environment. The popularity…

We investigate students' negative perceptions about an online peer assessment system for undergraduate writing across the disciplines. Specifically, we consider the nature of students' resistance to peer assessment; what factors influence that resistance; and how students' perceptions impact their revision work. We do this work by first examining…

Athletes who suffer from concussions under report their symptoms in order to expedite their return to competition. Athletic trainers and coaches must be aware of what is going on with athletes, even if it means requiring them to refrain from competition. Ninety percent of concussions are minor and can be difficult to diagnosis. There is a lack of…

The Functional Measurement approach, proposed within the theoretical framework of Information Integration Theory (Anderson, 1981, 1982), can be a useful multi-attribute analysis tool. Compared to the majority of statistical models, the averaging model can account for interaction effects without adding complexity. The R-Average method (Vidotto &…

Despite three decades of advances in information and communications technology (ICT) and a generation of research on cognition and new pedagogical strategies, the field of assessment has not progressed much beyond paper-and-pencil item-based tests. Research has shown these instruments are not valid measures of sophisticated intellectual…

An online interactive geometry item was developed to explore students' abilities to create prototypical and "tilted" rectangles out of line segments. The item was administered to 1,002 students. The responses to the item were hand-coded as correct, incorrect, or incorrect with possible evidence of a misconception. A variation of the nearest…