In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Technology has been part of the language learning process, both inside and outside the classroom, for decades, helping to bridge the gap between different contexts of learning. At the same time, the concept of lifelong-learning has widened our understanding of what learning is, what different forms it can take, and of the importance of considering…

The Guidelines for Good Practice of the European Association for Language Testing and Assessment (EALTA) stress the importance of collaboration between all parties involved in the process of developing instruments, activities and programmes for testing and assessment. Collaboration is considered to be as important as validity and reliability,…

The Bologna Declaration brought reforms into higher education that imply changes in teaching methods, didactic materials and textbooks, infrastructures and laboratories, etc. Statistics and mathematics are disciplines that traditionally have the worst success rates, particularly in non-mathematics core curricula courses. This research project,…

This technical report documents the procedures followed in developing student and teacher surveys to gather information about the accommodations students are accustomed to receiving and those that might be beneficial on a mathematics test delivered on the computer. It provides documentation of the technical adequacy of the survey instruments, as…