Effective and efficient measurement of the development of skill and knowledge, especially in domains of human activity that involve complex and challenging problems, is important with regard to workplace and academic performance. However, there has been little progress in the area of practical measurement and assessment, due in part to the lack of…

Schools and districts should use a well-designed needs assessment to inform important decisions about a range of technology program areas. Presently, there is a lack of valid and reliable instruments available and accessible to schools to effectively assess their educational needs to better design and evaluate their projects and initiatives. The…

Although the business community increasingly recognizes information literacy as central to its work, there remains the critical problem of measurement: How should employers assess the information literacy of their current or potential workers? In this article, we use a commercially available assessment to investigate the relationship between…

This article reports the move from paper-based marking (PBM) to onscreen marking (OSM) in Hong Kong for the subject Liberal Studies--whose objectives involve broadening students' horizons through critical examination of current issues. While currently a small candidature subject of approximately 3300, from 2009, the subject will become compulsory…

Offering a series of diagnosis and individual remedial learning activities for a general class by means of web and multimedia technology can overcome the dilemma of conventional diagnosis and remedial instruction. The study proposes a three-layer conceptual framework and adopts a two-tier diagnostic test theory to develop a web-based two-tier…

This article details an investigation into onscreen marking (OSM) in Hong Kong--where paper-based marking (PBM) is being phased out, to be completely superseded by OSM. It is a specific follow-up to a larger study (Coniam, 2009a) involving 30 raters who had previously rated English language essay scripts on screen in the 2007 Hong Kong Certificate…

Students of a required biology course for non-science majors were given an opportunity to take online multiple choice quizzes during the weekend interval between classes. Incentives were that they would be given extra credit for their participation. Questions from the quizzes were then placed on the next exam. After the exam was given, the number…

Computer-based testing (CBT) to assess second language ability has undergone remarkable development since Garret (1991) described its purpose as "the computerized administration of conventional tests" in "The Modern Language Journal." For instance, CBT has made possible the delivery of more authentic tests than traditional paper-and-pencil tests.…

In education, artificial intelligence (AI) has not made much headway. In the one area where it would seem poised to lend the most benefit--assessment--the reliance on standardized tests, intensified by the demands of the No Child Left Behind Act of 2001, which holds schools accountable for whether students pass statewide exams, precludes its use.…

This is a study with descriptive hypothesis-testing design investigating the true nature of L2 grammatical proficiency via focusing on its component parts. It examines the performance of 60 female EFL learners between 19 and 30 years of age at 2 proficiency levels using 2 types of computerized Grammaticality Judgement tasks in different orders…

In this paper, we present a framework for the development of collaborative design games that can be employed in participatory design sessions with students for the design of educational applications. The framework is inspired by idea generation theory and the design games literature, and guides the development of board games which, through the use…

This handbook outlines procedures for sharing student data between schools and the Ministry of Education, and answers questions pertaining to provincial examinations. It supports the work of both educators and the Ministry, which works with schools to produce transcripts and administer provincial exams. The following are appended: (1) Forms; and…

Test security has been a concern for computerized adaptive tests (CAT) due to the nature of continuous testing. This concern becomes unprecedentedly severe with increasingly easy access to the World-Wide-Web where some examinees post on the internet their recollections of items they are administered, leaving future examinees with opportunities to…

After a brief review of recent advances in sequential analysis involving sequential generalized likelihood ratio tests, we discuss their use in psychometric testing and extend the asymptotic optimality theory of these sequential tests to the case of sequentially generated experiments, of particular interest in computerized adaptive testing. We…

The attrition of special education teachers greatly affects the quality of special education services districts can provide for students with disabilities and creates an ongoing challenge for educational leaders. It is essential to understand the factors influencing special education teachers' decisions to leave or remain in the field. If…