SIGCSE Virtual 2024
Thu 5 - Sun 8 December 2024
Sat 7 Dec 2024 17:30 - 18:00 at Track 1 - Papers 3: AI (2)

Problem decomposition is an important skill in programming, allowing learners to break down complex tasks into manageable subgoals. However, translating these subgoals into executable code poses a significant challenge for novice programmers. In this study conducted in an introductory programming course, learners received instruction in stepwise refinement and integration of AI-generated code within their assignments. Throughout the course, learners were permitted to rely on AI code generators, following opportunities to receive feedback on their ability to read and write code without AI assistance. Our findings show that learners frequently relied on AI-generated code when working on assignments outside the classroom, but that the frequency of reliance varied from one assignment to another. The reliance on AI-generated code was not correlated with the learners’ year in their degree, nor whether they were enrolled in a CS degree or not. Instead, it was associated with their prior knowledge, as learners who were less proficient in reading and writing code were more likely to seek AI assistance. AI tools were primarily used to translate subgoals into code, fix errors, and explain algorithmic concepts. Few learners encountered difficulties in understanding or integrating AI generated code into their solutions. Overall, learner performance in meeting assignment requirements was relatively high, regardless of their prior knowledge or reliance on AI code generators. We conclude that leveraging the capabilities of generative AI can effectively bridge the gap between problem-solving and implementation, enabling learners to engage in skills that might otherwise be beyond their reach.

Sat 7 Dec

Displayed time zone: (UTC) Coordinated Universal Time change

16:30 - 18:00
Papers 3: AI (2)Conference at Track 1
16:30
30m
Paper
A Benchmark for Testing the Capabilities of LLMs in Assessing the Quality of Multiple-choice Questions in Introductory Programming Education
Conference
Aninditha Ramesh Carnegie Mellon University, Arav Agarwal Carnegie Mellon University, Jacob Doughty Carnegie Mellon University, Ketan Ramaneti Carnegie Mellon University, Jaromir Savelka Carnegie Mellon University, Majd Sakr Carnegie Mellon University
17:00
30m
Paper
Examining the Relationship between Socioeconomic Status and Beliefs about Large Language Models in an Undergraduate Programming Course
Conference
Amy Pang University of Michigan, Aadarsh Padiyath University of Michigan - Ann Arbor, Diego Viramontes Vargas University of Michigan, Barbara Ericson University of Michigan
17:30
30m
Paper
Generative AI in Introductory Programming Instruction: Examining the Assistance Dilemma with LLM-Based Code Generators
Conference
Eric Poitras Dalhousie University, Brent Crane Dalhousie University, Angela Siegel Dalhousie University