Over the past decade, social scientists have adapted computational methods for qualitative text analysis, with the hope that they can match the accuracy and reliability of hand coding. The emergence of GPT and open-source generative large language models (LLMs) has transformed this process by shifting from programming to engaging with models using…

Using a quasi-experimental method and content analysis as a technique, this study tests ChatGPT, in its version 4, by assessing its textual characteristics and overall understanding regarding the recognition criteria of provisions under International Accounting Standards (IAS) 37, as issued by the International Accounting Standards Board (IASB).…

An increasing number of studies have investigated how ChatGPT can aid in written assessment and feedback provision. However, many studies overlook its conversational design and underlying architecture, raising concerns about the reliability and validity of their analytical outputs. Therefore, applying first principles thinking to prompt use, and…

Presented study seeks to examine the potential applications of the OpenAI language model, GPT-3, within the realm of education. Specifically, the inquiry focuses on the feasibility of utilizing GPT-3 to generate essays based on customized prompts. To this end, the experimentation involved providing GPT-3 with tailored prompts derived from diverse…

Large language models present new opportunities for teaching and learning. The response accuracy of these models, however, is believed to depend on the prompt quality which can be a challenge for students. In this study, we aimed to explore how undergraduate students use ChatGPT for problem-solving, what prompting strategies they develop, the link…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…