Conducting high-quality overviews of reviews (OoR) is time-consuming. Because the quality of systematic reviews (SRs) varies, it is necessary to critically appraise SRs when conducting an OoR. A well-established appraisal tool is A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, which takes about 15-32 min per application. To save time,…

Learning performance data, such as correct or incorrect answers and problem-solving attempts in intelligent tutoring systems (ITSs), facilitate the assessment of knowledge mastery and the delivery of effective instructions. However, these data tend to be highly sparse (80%90% missing observations) in most real-world applications. This data…

The "Building Your Research Data Management Toolkit" was developed to provide introductory research data management skills training to liaisons in academic libraries. This paper assesses the participants' perceived change in knowledge, behaviors and attitudes as a result of participation in the RoadShow program. Long term changes in…

Background and Context: Computational thinking (CT) has been increasingly added to K-12 curricula, prompting teachers to grade more and more CT artifacts. This has led to a rise in automated CT assessment tools. Objective: This study examines the scope and characteristics of publications that use machine learning (ML) approaches to assess…

Agent-based models (ABMs) often rely on psychometric constructs such as 'opinions', 'stubbornness', 'happiness', etc. The measurement process for these constructs is quite different from the one used in physics as there is no standardized unit of measurement for opinion or happiness. Consequently, measurements are usually affected by 'psychometric…

For assessments that use different forms in different administrations, equating methods are applied to ensure comparability of scores over time. Ideally, a score scale is well maintained throughout the life of a testing program. In reality, instability of a score scale can result from a variety of causes, some are expected while others may be…

The level of information technology is increasing, and technology is developed. University English teaching has also changed under its influence. Different from the traditional teaching in the past, more and more students adopt the mode of "Internet + Smartphone" to learn English. This paper proposes a teaching mode evaluation method in…

Artificial Intelligence (AI) based assessments are commonly used in a variety of settings including business, healthcare, policing, manufacturing, and education. In education, AI-based assessments undergird intelligent tutoring systems as well as many tools used to evaluate students and, in turn, guide learning and instruction. This chapter…

OBE concept is a new teaching mode which emphasizes the improvement of students' subjective initiative and professional practice ability. The teaching of animation course is based on drawing and computer, which requires teachers to understand the OBE mode of animation course, carry out targeted teaching innovation of animation course, and adjust…

Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

Collecting treatment integrity data is critical for (a) strengthening internal validity within a research study, (b) determining the impact of an intervention on student outcomes, and (c) assessing the need for implementation supports. Although researchers have noted the increased inclusion of treatment integrity data in published articles, there…

In 2012, this author published a paper describing a method for using the raw data from Web of Science to examine the journals cited by any given group of researchers and then compare that list to lists of 'top journals' of similar disciplines. It was not a straightforward method to use and required a great deal of effort and spreadsheet work by a…

Despite increasing pressure for policy and practice to adopt a more evidence-based approach, transferring evidence into use remains a stubborn challenge. This is largely due to a number of researcher-derived and user-derived barriers at play within institutions, organisations and systems that constrain active engagement with evidence. This paper…

With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and…

Monte Carlo methods are an accepted methodology in regards to generation critical values for a Maximum test. The same methods are also applicable to the evaluation of the robustness of the new created test. A table of critical values was created, and the robustness of the new maximum test was evaluated for five different distributions. Robustness…