This article aimed to map the evaluation use, identify the affecting factors, and analyze how they are related in the context of the Brazilian graduate evaluation system, which involves more than 7,000 master's and doctoral programs. Interviews were conducted with a representative sample of Professors, Graduate Program Coordinators, and Research…

This paper begins by establishing the A+ Inquiry model as a theoretical lens for assessing needs related to program assessment workload by demonstrating its alignment with elements of five published frameworks associated with higher education assessment. Then, it uses the model as a frame of reference to explore faculty needs related to program…

In this study, the accuracy of the artificial neural network (ANN) was assessed considering the uncertainties associated with the randomness of the data and the lack of learning. The Monte-Carlo algorithm was applied to simulate the randomness of the input variables and evaluate the output distribution. It has been shown that under certain…

This research aims to present a Fuzzy Expert System with psychologist expertise that seeks to assist professors, researchers and educational institutions in assessing the level of incorporation of students' Soft Skills while attending Active Learning sessions. The difficulties encountered by higher education institutions, researchers and…

The Joint Research Centre (JRC) is the European Commission's in-house science and knowledge service, employing a substantial staff of scientists devoted to conducting research to provide independent scientific advice for EU policy. Focussed on various research areas aligned with EU priorities, the JRC excels in delivering scientific evidence for…

Accounting for model misspecification in Bayesian structural equation models is an active area of research. We present a uniquely Bayesian approach to misspecification that models the degree of misspecification as a parameter--a parameter akin to the correlation root mean squared residual. The misspecification parameter can be interpreted on its…

In 2020, a new curriculum, Kunnskapsløftet 2020 (LK20), was introduced in Norwegian schools. This study investigated how physical education (PE) teachers in upper secondary schools have changed their assessment practice following the introduction of LK20. To achieve this, nine individual in-depth interviews were conducted with PE teachers from six…

This research examined the needs assessment and development guidelines for participatory school management to enhance academic effectiveness in Provincial Administrative Organization (PAO) schools across Northeast Thailand. The study employed a mixed-methods design conducted in two phases. The first phase involved document synthesis and survey…

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on knowledge of the underlying data generating process. In this paper, we focus on design-based weights, which do…

In response to a growing awareness of the oppressive foundations of educational institutions, literacy educators have turned to antiracist, culturally responsive (Alim and Paris; Paris), and equitable teaching and assessment practices to combat the inequities (colonialism, racism, sexism, homophobia, ableism, etc.) on which our institutions are…

Determining the number of dimensions is extremely important in applying item response theory (IRT) models to data. Traditional and revised parallel analyses have been proposed within the factor analysis framework, and both have shown some promise in assessing dimensionality. However, their performance in the IRT framework has not been…

Higher Education Institutions (HEIs) need a specialized computer audit method to minimize quality and security risks and facilitate institutional evaluation and accreditation. This study aimed to develop a Computer Audit Method for HEIs (MAIIES) providing methodological support for the computer audit process. The MAIIES method includes planning,…

This article compares the purposes and content of the four foundational documents of the American Evaluation Association (AEA): the Program Evaluation Standards, the AEA Public Statement on Cultural Competence in Evaluation, the AEA Evaluator Competencies, and the AEA Guiding Principles. This reflection on alignment is an early effort in the third…

This study investigates the perspectives of 12 journal reviewers from diverse academic disciplines on using large language models (LLMs) in the peer review process. We identified key themes regarding integrating LLMs through qualitative data analysis of verbatim responses to an open-ended questionnaire. Reviewers noted that LLMs can automate tasks…

Quality Assessment Frameworks (QAFs) are standardized templates that include pre-defined criteria, open questions, or a combination to assess the quality of evaluations. They support organizations to limit risks associated with poor-quality evaluation. Qualitative research focused on four QAFs shows that five dimensions of quality are assessed…