An Investigation into ChatGPT Generated Assessments: Can We Tell the Difference? (73733)

Session Information: Design, Implementation & Assessment of Innovative Technologies in Education
Session Chair: Norma Flores González

Friday, 22 September 2023 14:30
Session: Session 3
Room: Gotic
Presentation Type:Changed to Virtual Presentation

All presentation times are UTC + 2 (Europe/Madrid)

The impact of ChatGPT has been revolutionary in many capacities however institutions are beginning to see the gradual increase in students passing off AI generated work as their own. This has negative impacts for student learning and academic integrity. One way to help combat this is to understand if we can tell the difference between AI generated assignments and original pieces of work. This will help those involved in assessing to distinguish between AI generated work compared to original work. In the initial phase of this study, we use ChatGPT to generate assessments for 3 modules in the department of Biochemical Engineering, UCL. These assignments capture the interdisciplinary nature of Biochemical Engineering as well as the diversity in assignment complexity and include mathematics, business and bioprocess quality control. We then convene academic leads and marking staff to assess scripts, compare them to previous cohorts and use peer-observation to find out what indicators there are of generated work. Results so far have shown that out of the 3 modules, 2 modules receive a pass mark with minimal prompts and only 1 module lead was able provide indicators to identify generated work. Results also show that ChatGPT was unable to provide solutions for complex mathematical problems, bioprocess piping and instrumentation technical drawings and critical analysis required for M-level bioprocess quality control. Subsequent phases of the study will expand the number of modules tested on ChatGPT, embed its use into the engineering curriculum and upskill academics on the use of AI tools.

Authors:
Chika Nweke, University College London, United Kingdom
Matthew Banner, University College London, United Kingdom


About the Presenter(s)
Dr Mauryn Nweke is a University Assistant Professor/Lecturer at University College London in United Kingdom

See this presentation on the full scheduleFriday Schedule



Virtual Presentation


Conference Comments & Feedback

Place a comment using your LinkedIn profile

Comments

Share on activity feed

Powered by WP LinkPress

Share this Presentation

Posted by Clive Staples Lewis

Last updated: 2023-02-23 23:45:00