Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to facilitate model estimation. These incomplete scoring designs present challenges for…

Many national science frameworks (e.g., Next Generation Science Standards) argue that developing mathematical modeling competencies is critical for students' deep understanding of science. However, science teachers may be unprepared to assess these competencies. We are addressing this need by developing virtual lab performance assessments that…

When grading students' quizzes and exams, I find that students are seemingly always changing their answers from the right answer to the wrong answer. In fact, I have cautioned students against changing their answer. Colleagues have made similar observations and some books on test-taking strategies advise against answer-changing. In an effort to…

Most organic chemistry reactions occur by a mechanism that includes acid-base chemistry, so it is important that students develop and learn to use correct conceptions of acids and acid strength. Recent studies have described undergraduate organic chemistry students' cognitive resources related to the Brønsted-Lowry acid model and the Lewis acid…

As data-based decision making is receiving increased attention in education, more and more school performance feedback systems (SPFSs) are being developed and used worldwide. These systems provide schools with data on their functioning. However, little research is available on the characteristics of the different SPFSs. Therefore, this study…

This study examined high school marketing education teachers' knowledge of workplace readiness skills and whether that knowledge had an impact on student workplace readiness skill achievement. Further, this study examined the usage of Virginia's 13 Workplace Readiness Skills curriculum and identified the teaching methods and instructional…

In the equating literature, a recurring concern is that equating functions that utilize a single anchor to account for examinee groups' nonequivalence are biased when the groups are extremely different and/or when the anchor only weakly measures what the tests measure. Several proposals have been made to address this equating bias by incorporating…

The authors present work towards automatically assessing data collection behaviors as middle school students engage in inquiry within a physics microworld. In this study, the authors used machine learned models that can detect when students test their articulated hypotheses, design controlled experiments, and engage in planning behaviors using…

In this paper, the entries of Lang-8, which is a Social Networking Site (SNS) site for learning and practicing foreign languages, were analyzed and found to contain similar rates of errors for most error categories reported in previous research. These similarly rated errors were then processed using an algorithm to determine corrections suggested…

Mixed-format assessments are increasingly being used in large scale standardized assessments to measure a continuum of skills ranging from basic recall to higher order thinking skills. These assessments are usually comprised of a combination of (a) multiple-choice items which can be efficiently scored, have stable psychometric properties, and…

We apply a "tutorial design process", which has proven to be successful for a number of physics topics, to design curricular materials or "tutorials" aimed at improving student understanding of important concepts in a university-level introductory materials science and engineering course. The process involves the identification…

These proceedings contain the papers of the International Conference e-Learning 2018, which was organised by the International Association for Development of the Information Society, 17-19 July, 2018. This conference is part of the Multi Conference on Computer Science and Information Systems 2018, 17-20 July, which had a total of 617 submissions.…

This paper reports on data collected via an audience response system, where a convenience sample of 300 adults aged 17-50 pressed a button to register their answers for twenty multiple choice questions. The responses were then discussed with the respondents at the time. The original dataset includes physics, biology and chemistry questions. The…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

This article discusses the assumptions required by the item response theory (IRT) true-score equating method (with Stocking & Lord, 1983; scaling approach), which is commonly used in the nonequivalent groups with an anchor data-collection design. More precisely, this article investigates the assumptions made at each step by the IRT approach to…