The agreement between raters is examined within the scope of the concept of "inter-rater reliability". Although there are clear definitions of the concepts of agreement between raters and reliability between raters, there is no clear information about the conditions under which agreement and reliability level methods are appropriate to…

This paper explores potential ways of evaluating the implicit learning that may be present in autonomous smart learning activities and environments, reflecting on prior phenomenographic research into smart learning activities positioned as local journeys in urban connected public spaces. Implicit learning is considered as intrinsic motivation,…

During the last decades, digital competence has become essential at workplace. Nowadays, it is difficult to find a job where no ICT skills are required. At the same time, there is a lack of ecosystems for adult reskilling in digital competence. Moreover, most of them do not use of a common language and terminology, decreasing the possibilities of…

Purpose: Program evaluation stands as an evidence-based process that would allow institutions to document and improve the quality of graduate programs and determine how to respond to growing calls for aligning training models to economic realities. This paper aims to present the current state of evaluation in research-based doctoral programs in…

Two previous studies mapping university mathematics students' summative assessment diet in the UK revealed a clear picture. In general, there was a dominance of closed book examinations with a strong relationship to departmental league table position. The decade since then has seen many changes in higher education in the UK, particularly in the…

We provide an update on the "electrochemistry designette" in relation to its pedagogical effectiveness to students and experiential learning. We have previously proposed that the designette be applied as an assessment tool to measure the students' competence on electrochemical principles through a series of objective metrics. Based on…

This article provides an overview of the unique model and comprehensive approach to tracking, enhancing, and assessing students' global learning outcomes at the University of Pittsburgh's University Center for International Studies (UCIS). In the conclusion, the authors provide a discussion of strengths and challenges of this model that will be…

Background: The coronavirus disease 2019 (COVID-19) pandemic has renewed interest in the use of ultrasound (US) amongst dysphagia-trained clinicians working with infants and children. US is a portable, minimally intrusive tool which carries reduced risk of aerosol-generation provoked by other instrumental swallowing assessment tools such as…

Setting cut scores on (MSTs) is difficult, particularly when the test spans several grade levels, and the selection of items from MST panels must reflect the operational test specifications. In this study, we describe, illustrate, and evaluate three methods for mapping panelists' Angoff ratings into cut scores on the scale underlying an MST. The…

Over the past decade, testing and assessing spoken-language interpreting has garnered an increasing amount of attention from stakeholders in interpreter education, professional certification, and interpreting research. This is because in these fields assessment results provide a critical evidential basis for high-stakes decisions, such as the…

Teacher evaluation has been at the forefront of accountability-related reforms in the United States due to the realization that teacher effectiveness is a major contributor to student success. Data from evaluations have revealed vital insights into contributing factors to teacher effectiveness and generated valuable information for hiring,…

In 2015, a multidisciplinary group of academic researchers and extension personnel was awarded a US Department of Agriculture Coordinated Agricultural Project grant. The team's goal was to understand human decision-making in the context of potential livestock disease outbreaks, investigating the impediments to increased adoption of biosecurity…

The COVID-19 pandemic provoked an urgency for many educators to integrate digital information and communication technologies in their educational practices. We explored how faculty members tackled the task of adapting their assessment practices during the pandemic to identify what is required to sustain and favour future quality development and…

In recent years, there has been an increasing emphasis on the use of functional assessment (FA) in the selection of treatments for problem behaviors. Scholars now generally accept that an understanding of the antecedents and consequences of problem behavior, achieved through a FA, is necessary to select the most effective treatment procedure. Yet,…

In the Greek educational system, students of the third grade of general and vocational high schools, who wish to enter higher education institutions with an economic orientation, must choose the scientific field "economics and computer sciences". In this field, one of the most important subjects examined is 'Principles of Economic…