The International Computer and Information Literacy Study (ICILS) 2013, conducted by the International Association for the Evaluation of Educational Achievement (IEA), studied how students in different countries develop the knowledge, understanding, attitudes, dispositions, and skills that comprise computer and information literacy (CIL). The aim…

This study investigates the relationship between performances on the speaking component of the TOEFL iBTTM with performances on academic oral assessment tasks. For the academic tasks, we recorded and transcribed the performances of five local and five high-achieving international undergraduate students on oral assessment tasks in core first-year…

This mixed-methods study investigates writers' task representation and the factors affecting it in test-like and non-test-like conditions. Five advanced-level L2 writers wrote two argumentative essays each, one in test-like conditions and the other in non-test-like conditions where the participants were allowed to use all the time and online…

In this interpretative phenomenological analysis (IPA) study, we found that the experiences of online teachers are highly complex and individualized, and that the development of their concerns as teachers is largely unaffected by years of teaching experience. Because of the dramatic increase in online K-12 education, there is a need for additional…

This technical report documents the processes and procedures implemented to support the Spring 2019 Nebraska Student-Centered Assessment System (NSCAS) General Summative English Language Arts (ELA), Mathematics, and Science assessments by NWEA® under the supervision of the Nebraska Department of Education (NDE). The technical report shows how the…

Many standardized tests are now administered via computer rather than paper-and-pencil format. In a computer-based testing environment, it is possible to record not only the test taker's response to each question (item) but also the amount of time spent by the test taker in considering and answering each item. Response times (RTs) provide…

As students work through online learning systems such as the Reasoning Mind blended learning system, they often are not confined to working within a single educational activity; instead, they work through various different activities such as conceptual instruction, problem-solving items, and fluency-building games. However, most work on assessing…

Item replenishing is essential for item bank maintenance in cognitive diagnostic computerized adaptive testing (CD-CAT). In regular CAT, online calibration is commonly used to calibrate the new items continuously. However, until now no reference has publicly become available about online calibration for CD-CAT. Thus, this study investigates the…

Science standards have been a topic in educational research in Austria for about ten years now. Starting in 2005, competency structure models have been developed for junior and senior classes of different school types. After evaluating these models, prototypic tasks were created to point out the meaning of the models to teachers. At the moment,…

Onscreen marking (OSM) has been used for the majority of Hong Kong public examinations since 2012. The current study compares marker reactions to OSM, ie, perceived ease of use and acceptance of OSM, against the backdrop of virtually all subject areas being marked on screen. The data were collected from three major sources: (1) survey data…

Problems faced by engineering students involve multiple pathways to solution. Students rarely receive effective formative feedback on handwritten homework. This paper examines the potential for computer-based formative assessment of student solutions to multipath engineering problems. In particular, an intelligent tutor approach is adopted and…

The use of computer-based assessments makes the collection of detailed data that capture examinees' progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies,…

This article summarizes the methods, observations, challenges and implications for exploratory analysis drawn from two learning analytics research projects. The cases include an analysis of a games-based virtual performance assessment and an analysis of data from 52,000 students over a 5-year period at a large Australian university. The complex…

The paper describes initial efforts on creating a system for the automatic assessment of Swedish second language (L2) learner essays from two points of view: holistic evaluation of the reached level according to the Common European Framework of Reference (CEFR), and the lexical analysis of texts for receptive and productive vocabulary per CEFR…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…