The Human Resources Development Service of Korea developed a digital exam for five representative engineering categories and conducted a pilot study comparing the findings with the paper-and-pencil exam results from the last three years. This study aimed to compare the test efficiency between digital and paper-and-pencil examinations. A digital…

What follows is a practical guide for establishing the validity of a survey for research purposes. The motivation for providing this guide is our observation that researchers, not necessarily being survey researchers per se, but wanting to use a survey method, lack a concise resource on validity. There is far more to know about surveys and survey…

This pilot study examines digital SAT® score relationships with first-year college performance. Results show that digital SAT scores predict college performance as well as paper and pencil SAT scores, and that digital SAT scores meaningfully improve our understanding of a student's readiness for college above high school grade point average…

In this study, I examined how 34 Spanish-speaking English language learners (ELLs) used their linguistic resources (English and Spanish) and language modes (oral and written language) to demonstrate their knowledge of proportional reasoning in a dual language mathematics assessment task. The assessment allows students to see the item in both…

This research developed an approach to integrate the complementary benefits of digitized assessments and peer learning. Its basic premise and associated hypotheses are that by using student assessments of correct and incorrect quiz answers using a fine-grained resolution to pair them into remediation peer-learning cohorts is an effective means of…

The professionalisation of teaching is of increasing importance in UK higher education due to converging processes including the proliferation of managerialism, increasing quality agendas and changes to student fee structures. These have brought into sharp relief the need for greater understanding of how quality teaching evolves in university…

The Next Generation Science Standards propose a multidimensional model of science learning, comprised of Core Disciplinary Ideas, Science and Engineering Practices, and Crosscutting Concepts (NGSS Lead States, 2013). Accordingly, there is a need for student assessment aligned with the new standards. Creating assessments that validly and reliably…

Critical thinking is frequently proposed as one of the most important learning outcomes of a university education. However, to date, it has been difficult to ascertain whether university students in low-income contexts are improving in their critical thinking skills, because the limited studies in this domain have relied on instruments developed…

The purpose of this study was to investigate effects of music notation reinforcement on aural memory for melodies. Participants were 41 undergraduate and graduate music majors in a within-subjects design. Experimental trials tested melodic memory through a sequence of target melodies, distraction melodies, and matched and unmatched answer choices.…

This study sought academic staff and students' views of electronic exams (e-exams) system and the benefits and challenges of e-exams in general. The respondents provided useful feedback for future adoption of e-exams at an Australian university and elsewhere too. The key findings show that students and academic staff are optimistic about the…

Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

This article details the construction of a computer program to test cognitive processing differences in adolescents engaged in a standard presentation of tests versus a fantasy-based game presentation. The article will discuss the challenges of creating a replication of traditional psychological tests into a new medium which holds comparable…

This article examines the influence of keyboarding versus handwriting in a high-stakes writing assessment. Conclusions are based on data collected from a pilot project to move Old Dominion University's Exit Exam of Writing Proficiency from a handwritten format into a dual-option format (i.e., the students may choose to handwrite or keyboard the…

As part of the test development process, this technical report is intended to present technical information from the tryout and the pilot stages of the Michigan High School Proficiency Test (HSPT) in Communication Arts: Reading. There are four major parts to this report. Part 1, Evolution of the HSPT in Communication Arts: Reading, introduces the…