Study Quantifies LLM Impact on Course Design and Student Learning
New research reveals how GenAI reshapes teaching methods and grades...
Deep Dive
Researchers Potasznik and Haehn conducted a mixed-methods, multi-course study at a New England university using surveys, grade data, and instructor feedback to measure changes after LLM adoption. The research seeks to identify patterns in student and faculty perceptions and experiences, aiming to serve as a pilot study to inform GenAI policies across higher education.
Key Points
- Mixed-methods study uses grade data from registrar, instructor surveys, and student surveys at a New England university
- Instructors are redesigning course structures to account for LLM use, with visible shifts in grade distributions between pre- and post-LLM eras
- Students report using GenAI both as a learning aid and for unauthorized completion, complicating policy decisions
Why It Matters
First quantitative evidence linking LLM adoption to measurable changes in teaching and grading—critical for future education policy.