Jonathan H. Choi (University of Minnesota Law School), Kristin E. Hickman (University of Minnesota - Twin Cities - School of Law), Amy Monahan (University of Minnesota Law School), & Daniel Schwarcz (University of Minnesota Law School) have posted ChatGPT Goes to Law School on SSRN. Here is the abstract:
How well can AI models write law school exams without human assistance? To find out, we used the widely publicized AI model ChatGPT to generate answers on four real exams at the University of Minnesota Law School. We then blindly graded these exams as part of our regular grading processes for each class. Over 95 multiple choice questions and 12 essay questions, ChatGPT performed on average at the level of a C+ student, achieving a low but passing grade in all four courses. After detailing these results, we discuss their implications for legal education and lawyering. We also provide example prompts and advice on how ChatGPT can assist with legal writing.
Fascinating.
