TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM
Journal: Journal of Baltic Science Education (Vol.23, No. 2)Publication Date: 2024-04-20
Authors : Hunkoog Jho; Minsu Ha;
Page : 280-291
Keywords : argumentative writing; artificial intelligence; automated assessment; natural language processing; web architecture;
Abstract
This study aimed at examining the performance of generative artificial intelligence to extract argumentation elements from text. Thus, the researchers developed a web-based framework to provide automated assessment and feedback relying on a large language model, ChatGPT. The results produced by ChatGPT were compared to human experts across scientific and non-scientific contexts. The findings revealed marked discrepancies in the performance of AI for extracting argument components, with a significant variance between issues of a scientific nature and those that are not. Higher accuracy was noted in identifying claims, data, and qualifiers, as opposed to rebuttals, backing, and warrants. The study illuminated AI's promise for educational applications but also its shortcomings, such as the increased frequency of erroneous element identification when accuracy was low. This highlights the essential need for more in-depth comparative research on models and the further development of AI to enhance its role in supporting argumentation training.
Other Latest Articles
- CURRICULUM DEVELOPMENT BASED ON AN INTERDISCIPLINARY CONTEXT-BASED LEARNING APPROACH IN THE CONTEXT OF ELECTRICITY AND MAGNETISM
- EXAMINING PHYSICS TEACHERS’ DOMAIN-SPECIFIC PEDAGOGICAL CONTENT KNOWLEDGE COMPONENTS IN LESOTHO SECONDARY SCHOOLS
- DEVELOPMENT AND EFFECTIVENESS OF THE E-SKY MODULE BASED ON PBL IN THE TEACHING AND FACILITATION PROCESS OF EARLY SCIENCE
- IMPACT OF AI ROBOT IMAGE RECOGNITION TECHNOLOGY ON IMPROVING STUDENTS’ CONCEPTUAL UNDERSTANDING OF CELL DIVISION AND SCIENCE LEARNING MOTIVATION
- MODERATOR EFFECT OF MOBILE LEARNING ON STUDENTS’ ACHIEVEMENT IN PHYSICS: A META-ANALYSIS
Last modified: 2024-04-21 18:28:04