The national certification tests and entrance examinations are the most important tests for proving the ability or knowledge level of a person. To accurately evaluate the professional skills or knowledge level, the composed test sheets must meet multiple assessment criteria such as the ratio of relevant concepts to be evaluated and the estimated…

The purpose of this study was to investigate problems and potentials of new technologies in English writing education. The effectiveness of automated writing evaluation (AWE) ("MY Access") and of peer evaluation (PE) was compared. Twenty-two English as a foreign language (EFL) learners in Taiwan participated in this study. They submitted…

Purpose: The purpose of this paper is to exhibit the integration of learning and study strategies inventory (LASSI) with the City University of Hong Kong information systems to promote teaching and learning within the university. Design/methodology/approach: From the 2006 entry cohort, all undergraduate freshmen at City University of Hong Kong are…

Preliminary pilot studies and a field study show how a generalizable conceptual framework calibrated with item response modeling can be used to describe the development of student conceptual understanding in chemistry. ChemQuery is an assessment system that uses a framework of the key ideas in the discipline, called the Perspectives of Chemists,…

Assessing the language development of bilingual children can be a challenge--too often, children in the complex process of learning both Spanish and English are under- or over-diagnosed with language disorders. SLPs can change that with "SALT 2010 Bilingual S/E Version" for grades K-3, the first tool to comprehensively assess children's language…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

In the past decade, researchers have attempted to develop computer-assisted learning and testing systems to help students improve their learning performance. Conventional testing systems simply provide students with a score, and do not offer sufficient information in order to improve their learning performance. It would be of more benefit to…

Attitude, experience and competence (broadly covered by the European Computer Driving Licence syllabus) in information technology (IT) were assessed in 846 1st-year Medical Sciences Division undergraduates (2003-06) at the start of their first term. Online assessments delivered during induction workshops were presented as an opportunity for…

Since researchers acknowledged the several advantages of computerized adaptive testing (CAT) over traditional linear test administration, the issue of item exposure control has received increased attention. Due to CAT's underlying philosophy, particular items in the item pool may be presented too often and become overexposed, while other items are…

In this paper, we present two new methods for evaluating students' answerscripts based on the similarity measure between vague sets. The vague marks awarded to the answers in the students' answerscripts are represented by vague sets, where each element u[subscript i] in the universe of discourse U belonging to a vague set is represented by a…

In this article, Structural communication grid (SCG), an alternative measurement and evaluation technique, has been firstly summarised and the design, development and implementation of a computer based SCG system have been introduced. The system is then tested on a sample of 154 participants consisting of candidate students, science teachers and…

The complex nature and uncertain information in social problems required the emergence of fuzzy decision support systems in social areas. In this paper, we developed user-friendly Fuzzy Group Decision Support Systems (FGDSS) software. The software can be used for multi-purpose decision making processes. It helps the users determine the main and…

The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance.…

A key challenge of effective teaching is assessing and monitoring the extent to which students have assimilated the material they were taught. Concept mapping is a methodology designed to model what students have learned. In effect, it seeks to produce graphical representations (called concept maps) of the concepts that are important to a given…

In textbooks, foreign (second) language reading proficiency is often evaluated through comprehension questions. In case, authentic texts are used as reading material, such questions should be prepared by teachers. However, preparing appropriate questions may be a very demanding task for teachers. This paper introduces a method for automatically…