Search Results for author:
Found 11 papers, 2 papers with code
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
Inspired by recent work that has utilised very powerful LLMs, such as GPT-4, to evaluate the outputs produced by less powerful models, we conduct an automated analysis of the quality of the feedback produced by several open source models using a dataset from an introductory programming course.
Benchmarking Educational Program Repair
The emergence of large language models (LLMs) has sparked enormous interest due to their potential application across a range of educational tasks.
"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models
Grasping complex computing concepts often poses a challenge for students who struggle to anchor these new ideas to familiar experiences and understandings.
Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models
Unlike syntax errors, for which a compiler or interpreter can issue a message, logic errors can be subtle.
Can We Trust AI-Generated Educational Content? Comparative Analysis of Human and AI-Generated Learning Resources
In this study, we investigated the potential for LLMs to produce learning resources in an introductory programming context, by comparing the quality of the resources generated by an LLM with those created by students as part of a learnersourcing activity.
Exploring the Responses of Large Language Models to Beginner Programmers' Help Requests
At the same time, the results highlight the unreliability of LLMs: LLMs make some of the same mistakes that students do, perhaps especially when formatting output as required by automated assessment systems.
Computing Education in the Era of Generative AI
The computing education community has a rich history of pedagogical innovation designed to support students in introductory courses, and to support teachers in facilitating student learning.
Comparing Code Explanations Created by Students and Large Language Models
In this paper, we explore the potential of LLMs in generating explanations that can serve as examples to scaffold students' ability to understand and explain code.
Using Large Language Models to Enhance Programming Error Messages
Large language models can be used to create useful and novice-friendly enhancements to programming error messages that sometimes surpass the original programming error messages in interpretability and actionability.
Automatic Generation of Programming Exercises and Code Explanations using Large Language Models
Our analysis suggests that there is significant value in massive generative machine learning models as a tool for instructors, although there remains a need for some oversight to ensure the quality of the generated content before it is delivered to students.
Empirical Evaluation of Deep Learning Models for Knowledge Tracing: Of Hyperparameters and Metrics on Performance and Replicability
To evaluate how different aspects of DLKT models influence model performance, we test input and output layer variations found in the compared models that are independent of the main architectures.
