ChatGPT och programmering : En experimentell studie om effektivitet och upplevd användbarhet vid användandet av ChatGPT som hjälpmedel vid programmering

Sammanfattning: The recent widespread global use of ChatGPT has demonstrated immense applications for AI technology. With natural language as input, ChatGPT can generate and describe code in various programming languages. ChatGPT could enable the automation of repetitive tasks, thereby increasing efficiency. The aim of the study was to investigate whether the AI tool ChatGPT is a valuable resource for programmers to use in programming by examining whether the use of ChatGPT as an aid can lead to efficiency gains in programming and exploring how programmers perceive the usefulness of ChatGPT as an aid. In the study, a programmer is defined as a final-year student in the Bachelor’s Programme in Information Systems at Uppsala University. Quantitative data on time on task were collected through an experiment with code tests in the C# programming language to measure efficiency, and a survey based on SUS and ASQ was conducted in conjunction with the experiment to assess the perceived usefulness of ChatGPT. Participants were randomly assigned to control and experimental groups, where the experimental group used ChatGPT as an aid while the control group did not. The experimental group was on average 9.4 minutes faster than the control group, which was statistically significant. The perceived usefulness of ChatGPT was considered high based on SUS and ASQ, as the experimental group scored higher than the control group. The conclusion drawn is that ChatGPT is a valuable tool for programmers in programming, considering efficiency and perceived usefulness.