College students in a lower-division psychology course made metacognitive judgments by predicting and postdicting performance for true-false, multiple-choice, and fill-in-the-blank question sets on each of three exams. This study investigated which question format would result in the most accurate metacognitive judgments. Extending Koriat's (1997)…

As information and communication technologies develop in China, language tests are shifting from conventional paper-and-pencil testing to computerized testing. The aim of this study is to investigate Chinese test-takers' adaptability to computerized language exams, including their performance across testing modes and their perception of the…

In this paper, I investigate whether two-stage exams aid learning in undergraduate mathematics, as measured by students' performance on subsequent exams. In a two-stage exam, students complete the exam individually then form into groups to solve it again, with grades based on a combination of the two stages. Previous research in other disciplines…

Research suggests that certain characteristics of survey items may impact participants' responses. In this study we investigated the impact of several of these characteristics: vague wording, question-versus-statement phrasing, and full-versus-partial labeling of response options. We manipulated survey items per these characteristics and randomly…

Research-based multiple-choice questions implemented in class with peer instruction have been shown to be an effective tool for improving students' engagement and learning outcomes. Moreover, multiple-choice questions that are carefully sequenced to build on each other can be particularly helpful for students to develop a systematic understanding…

Introductory physics lab instruction is undergoing a transformation, with increasing emphasis on developing experimentation and critical thinking skills. These changes present a need for standardized assessment instruments to determine the degree to which students develop these skills through instructional labs. In this article, we present the…

This study aims to develop a test that can be used to explore mental models and representation patterns of objects in liquid fluid. The test developed by adapting the Reeves's Development Model was carried out in several stages, namely: determining the orientation and test segments; initial survey; preparation of the initial draft; try out;…

Research has suggested the important role of vocabulary knowledge in second language (L2) speaking proficiency. However, earlier studies tended to disregard the congruence in test format between assessing vocabulary knowledge and speaking skills with the former predominantly measured in written format. The current study measured vocabulary…

COVID-19 has changed the way we teach. Today, we have become far more experienced in the delivery of distance education and use of online tools. However, the quality of distance education and learning outcomes have become a matter of ongoing debate. Just as higher education aims to develop high-level skills in its students, researchers are seeking…

A new computer-assisted test of academic English for use at an Asian University was commissioned by administrators. The test was designed to serve both placement and diagnostic purposes. The authors and their team conceptualized, developed, and administered a scenario-based assessment with an online delivery with independent and integrated…

In the recreation and leisure field, educators often strive to attain a level of experiential learning in the classroom. As we prepare students for the future, it is unlikely that they will be placed in a quiet room and asked to take an objective test. It is more likely that they will be asked to defend their ideas, collaborate in decision making,…

According to the model of constructive alignment, learners adjust their learning strategies to the announced assessment (backwash effect). Hence, when teaching for understanding, the assessment method should be aligned with this teaching goal to ensure that learners engage in corresponding learning strategies. A quasi-experimental field study with…

Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…

This study investigated the efficacy of retrieving EFL vocabulary from memory as a long-term retention strategy. Three learning treatments, rereading, recognizing and recalling target words, were compared with the assistance of 74 university students who underwent the treatments to learn academic American English during a 15-week semester. In…

In the present study we investigated the effect of test format on oral performance in terms of test scores and discourse features (accuracy, fluency, and complexity). Moreover, we explored how the scores obtained on different test formats relate to such features. To this end, 23 Iranian EFL learners participated in three test formats of monologue,…