Recent investigations in automated essay scoring research imply that hybrid models, which combine feature engineering and the powerful tools of deep neural networks (DNNs), reach state-of-the-art performance. However, most of these findings are from holistic scoring tasks. In the present study, we use a total of four prompts from two different…

With the generative artificial intelligence (AI) tool's remarkable capabilities in understanding and generating meaningful content, intriguing questions have been raised about its potential as an automated essay scoring (AES) system. One such tool is ChatGPT, which is capable of scoring any written work based on predefined criteria. However,…

As generative AI (GenAI) continues to permeate academia, distinguishing between student-authored essays and those by Large Language Models (LLMs) becomes crucial for maintaining academic integrity. This study conducted a survey on the ethical awareness of using generative AI tools among a group of STEM students (n=156). Also, we empirically…

In response to (1) studies finding that essay feedback generated by ChatGPT might be useful for student writers and (2) studies observing ChatGPT's tendency to adhere to narrow genre definitions when producing writing, our study seeks to examine whether ChatGPT can provide useful feedback in a first-year writing learning environment that targets a…

The use of subordination enables language users to achieve syntactic efficiency by allowing them to connect ideas in temporal/logical relation. Although the importance of subordination has been recognized in previous research on second language (L2) writing, it has been typically assessed with global indices that measure overall ratio of…

Technological Advances in Artificial Intelligence (AI) have Brought forth the Potential for Models to Assist in Academic Writing. However, Concerns Regarding the Accuracy, Reliability, and Impact of AI in Academic Writing have been Raised. This Study Examined the Capabilities of GPT-4, a state-of-the-art AI Language Model, in Writing an American…

This study explores the use of large language models (LLMs) to generate feedback on essay-type assignments in Higher Education. Drawing on a seminal feedback framework, it examines the pedagogical and psychological effectiveness of LLM-generated feedback across three cohorts of MBA, MSc, and undergraduate students. Methods included linguistic…

This study explores the efficacy of ChatGPT-3.5, an AI chatbot, used as an Automatic Essay Scoring (AES) system and feedback provider for IELTS essay preparation. It investigates the alignment between scores given by ChatGPT-3.5 and those assigned by official IELTS examiners to establish its reliability as an AES. It also identifies the strategies…

An increasing number of studies have investigated how ChatGPT can aid in written assessment and feedback provision. However, many studies overlook its conversational design and underlying architecture, raising concerns about the reliability and validity of their analytical outputs. Therefore, applying first principles thinking to prompt use, and…

This study provides a comparative assessment of the capabilities of leading artificial intelligence (AI) tools and human participants in a business management education context. Specifically, we (a) assess how well current language models perform in providing answers to standardised essay-type assessments in a business and management education…

With the introduction of artificial intelligence (AI), particularly Generative AI (GenAI) to school settings, teachers are likely to be drawn into professional learning scenarios where they will be expected to learn how to use programs and applications for remediation and tutoring of children. Previous research highlights how professional learning…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

Generative large language models (LLMs) like ChatGPT can quickly produce informative essays on various topics. However, the information generated cannot be fully trusted, as artificial intelligence (AI) can make factual mistakes. This poses challenges for using such tools in college classrooms. To address this, an adaptable assignment called the…

Heightened concerns about the health of the teaching profession highlight the importance of studying the early teacher pipeline. This exploratory, descriptive article examines preservice teachers' expressed motivation for pursuing a teaching career. Using data from a large teacher education program in Texas, we use a natural language processing…

Generative AI has the potential to transform higher education assessment. This study examines the opportunities and challenges of integrating AI into coursework assessments, highlighting the need to rethink traditional paradigms. A case study is presented that explores AI as an auxiliary learning tool in postgraduate coursework. Students found AI…