no code implementations • 7 May 2024 • Lena Armstrong, Abbey Liu, Stephen MacNeil, Danaë Metaxa
In Study 1, we ask GPT to score resumes with 32 different names (4 names for each combination of the 2 gender and 4 racial groups) and two anonymous options across 10 occupations and 3 evaluation tasks (overall rating, willingness to interview, and hireability).
no code implementations • 14 Mar 2024 • Seth Bernstein, Paul Denny, Juho Leinonen, Lauren Kan, Arto Hellas, Matt Littlefield Sami Sarsa, Stephen MacNeil
Grasping complex computing concepts often poses a challenge for students who struggle to anchor these new ideas to familiar experiences and understandings.
no code implementations • 19 Jan 2024 • James Prather, Paul Denny, Juho Leinonen, David H. Smith IV, Brent N. Reeves, Stephen MacNeil, Brett A. Becker, Andrew Luxton-Reilly, Thezyrie Amarouche, Bailey Kimmel
In this paper, we propose a new way to teach programming with Prompt Problems.
no code implementations • 18 Jan 2024 • Albatool Wazzan, Stephen MacNeil, Richard Souvenir
Participants using traditional search more accurately predicted the location of the image compared to those using the LLM-based search.
no code implementations • 27 Nov 2023 • Stephen MacNeil, Paul Denny, Andrew Tran, Juho Leinonen, Seth Bernstein, Arto Hellas, Sami Sarsa, Joanne Kim
Unlike syntax errors, for which a compiler or interpreter can issue a message, logic errors can be subtle.
no code implementations • 3 Nov 2023 • Irene Hou, Owen Man, Sophie Mettille, Sebastian Gutierrez, Kenneth Angelikas, Stephen MacNeil
These capabilities have prompted instructors to rapidly adapt their courses and assessment methods to accommodate changes in learning objectives and the potential for academic integrity violations.
no code implementations • 1 Oct 2023 • James Prather, Paul Denny, Juho Leinonen, Brett A. Becker, Ibrahim Albluwi, Michelle Craig, Hieke Keuning, Natalie Kiesler, Tobias Kohn, Andrew Luxton-Reilly, Stephen MacNeil, Andrew Peterson, Raymond Pettit, Brent N. Reeves, Jaromir Savelka
Second, we report the findings of a survey of computing students and instructors from across 20 countries, capturing prevailing attitudes towards LLMs and their use in computing education contexts.
no code implementations • 8 Apr 2023 • Juho Leinonen, Paul Denny, Stephen MacNeil, Sami Sarsa, Seth Bernstein, Joanne Kim, Andrew Tran, Arto Hellas
In this paper, we explore the potential of LLMs in generating explanations that can serve as examples to scaffold students' ability to understand and explain code.
no code implementations • 27 Feb 2023 • Zijian Ding, Arvind Srinivasan, Stephen MacNeil, Joel Chan
Cross-domain analogical reasoning is a core creative ability that can be challenging for humans.