This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content modified to evade detection (n = 805). We compare these detectors to assess their reliability in identifying AI-generated text in educational settings, where they are increasingly used to address academic integrity…

Artificial Intelligence (AI) is shaping the future of higher education administration. "The Evolution of Artificial Intelligence in Higher Education" is a comprehensive guide to the transformative potential of AI in the higher education landscape, focused on the need to nurture technology literacy among educators and learners. Chapters…

Numerous studies have explored the intricacies of artificial intelligence (AI) in higher education, predominantly focusing on developed countries. However, there is a notable gap in examining the hindrances and untapped potential of AI implementation in the higher education sector within the South Asian Global South countries. This study aims to…

This study examines the potential and challenges of artificial intelligence applications like ChatGPT in higher education, drawing on the experiences of 24 academics from eight countries: Turkey, Sweden, Canada, Iran, Kenya, Pakistan, Afghanistan, and Japan. Employing the content analysis method, the findings reveal that ChatGPT provides…

This paper explores the concept of dynamically generating definitions using a deep-learning model. We do this by creating a dataset that contains definition entries and contexts associated with each definition. We then fine-tune a GPT-2 based model on the dataset to allow the model to generate contextual definitions. We evaluate our model with…

While young people are generally better educated today than ever before, recent graduates tend to lack practical skills -- especially digital skills. Certification programs offer one effective way to address this digital skills gap. They give learners a way to gain the skills they need to compete, and also to demonstrate credibly that they possess…

This study developed a framework that can be used to build a forum environment, referred to as a Collaborative Interaction Management System (CIMS) that incorporates an automated method of assessing student's individual contributions and group collaborative learning. The framework was fine-tuned by conducting a survey that identified 20 major…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

The qualitative research methodology of phenomenography has traditionally required a manual sorting and analysis of interview data. In this paper I explore a potential means of streamlining this procedure by considering a computer aided process not previously reported upon. Two methods of lexicological analysis, manual and automatic, were examined…

The INTASC Principles, when used as the basis for developing appropriate measurement instruments to assess teacher dispositions, provide a viable approach to the diagnosis and remediation of skill-related affective performance in teacher candidates and also to meeting NCATE requirements for Standard 1. In this symposium, the development and use of…

Describes a FORTRAN software program that calculates the probability of an observed difference between agreement measures obtained from two independent sets of raters. An example illustrates the use of the DIFFER program in evaluating undergraduate essays. (Author/SLD)

Four writing samples were obtained from 638 foreign college applicants who represented three major foreign language groups (Arabic, Chinese, and Spanish), and from 60 native English speakers. All four were scored holistically, two were also scored for sentence-level and discourse-level skills, and some were scored by the Writer's Workbench…

A discussion of the use of computerized spreadsheets for recording and analyzing college students' grades looks at a variety of issues of concern in any evaluation situation (data collection and control, allocating grades, checking consistency, analyzing relationships between items of assessment and grades), and illustrate them with examples from…

The method of paired comparisons was used to rank 42 dental students on their performance in emergency and screening clinic rotations. Results suggest this methodology may provide more internally consistent student assessments on more subtle aspects of clinical performance than those assessed by multiple-choice tests or written performance…

Describes what a computer-adaptive test (CAT) is, examines its roots, and points out some of the challenges this approach to assessment presents. (Author/VWL)