An increasing number of studies have investigated how ChatGPT can aid in written assessment and feedback provision. However, many studies overlook its conversational design and underlying architecture, raising concerns about the reliability and validity of their analytical outputs. Therefore, applying first principles thinking to prompt use, and…

This study investigates the perspectives of 12 journal reviewers from diverse academic disciplines on using large language models (LLMs) in the peer review process. We identified key themes regarding integrating LLMs through qualitative data analysis of verbatim responses to an open-ended questionnaire. Reviewers noted that LLMs can automate tasks…

The examination of the impact of Generative AI (GenAI) on higher education, especially from the viewpoint of students, is gaining significance. Although prior research has underscored GenAI's potential advantages in higher education, there exists a discernible research gap concerning the determinants that affect its adoption. In the present study,…

The emergence of Large Language Models (LLMs) has marked a significant change in education. The appearance of these LLMs and their associated chatbots has yielded several advantages for both students and educators, including their use as teaching assistants for content creation or summarisation. This paper aims to evaluate the capacity of LLMs…

Instructors use of Artificial Intelligence (AI) language models (i.e., chatbots) as an educational resource will require an understanding of students' AI literacy, namely their ability to critically reflect on the relevance, trustworthiness, and quality of these tools in the context of chemistry. This study sought to describe students' AI literacy…

This article explores the multifaceted implications of integrating advanced generative AI technologies, specifically ChatGPT, into academic writing and research. It delves into the potential benefits and challenges that arise from the speculative advancements of ChatGPT, emphasizing the dual-edged nature of its capabilities. On one hand, ChatGPT…

The interpretations of test scores in secure, high-stakes environments are dependent on several assumptions, one of which is that examinee responses to items are independent and no enemy items are included on the same forms. This paper documents the development and implementation of a C#-based application that uses Natural Language Processing…

Integrating artificial intelligence (AI) technologies into various educational domains has garnered significant attention. Among these technologies, ChatGPT stands out as a powerful tool that holds the potential to revolutionize the landscape of mathematics education. This study aims to explore the emerging trends and critical issues surrounding…

Background/purpose: Artificial intelligence, namely ChatGPT, has garnered significant interest in language education due to its potential to enhance instruction and learning. Three primary topics are highlighted in this study's analysis of recent research on ChatGPT's use in language instruction: Reflection on instruction, instructor feedback, and…

Background/purpose: The incorporation of generative artificial intelligence (AI) into higher education is transforming competency-based learning by enabling adaptive, interactive, and immersive environments. This study aimed to design and evaluate an innovation mechanism that integrates AI agents with 3D interfaces, focusing not only on technical…

Purpose: This study examines the accuracy of Interaction Detection in Early Childhood Settings (IDEAS), a program that automatically transcribes audio files and estimates linguistic units relevant to speech-language therapy, including part-of-speech units that represent features of language complexity, such as adjectives and coordinating…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

This article introduces Xiao-Shih, the first intelligent question answering bot on Chinese-based massive open online courses (MOOCs). Question answering is critical for solving individual problems. However, instructors on MOOCs must respond to many questions, and learners must wait a long time for answers. To address this issue, Xiao-Shih…

This study fit a Naïve Bayesian classifier to the words of exam items to predict the Bloom's taxonomy level of the items. We addressed five research questions, showing that reasonably good prediction of Bloom's level was possible, but accuracy varies across levels. In our study, performance for Level 2 was poor (Level 2 items were misclassified…

The potential of artificial intelligence (AI) in transforming education has received considerable attention. This study aims to explore the potential of large language models (LLMs) in assisting students with studying and passing standardized exams, while many people think it is a hype situation. Using primary education as an example, this…