Conference Paper

Explainable Feedback for Learning Based on Rubric-Based Multimodal Assessment Analytics with AI

Loading...
Thumbnail Image

Fulltext URI

Document type

Text/Conference Paper

Additional Information

Date

2024

Journal Title

Journal ISSN

Volume Title

Publisher

Gesellschaft für Informatik e.V.

Abstract

Providing timely formative feedback to students is very important to support self-regulated learning and deep learning strategies. Feedback has been shown to increase student engagement, satisfaction and learning outcomes, especially in generative learning tasks such as ePortfolios and other forms of multimodal compositions. However, the provision of detailed formative feedback places high demands on teachers’ resources. It would be highly beneficial if Large Language Models (LLM) could be used to support the feedback process. Therefore, this paper first describes a general architecture for multimodal formative assessment analysis and feedback generation. It is based on assessment rubrics, which are then used to build task-specific AI analysis pipelines to generate explainable assessment metrics, which are then used to produce helpful feedback. An example of a feedback pipeline for student video submissions in an ePortfolio is given, along with a prompting chain for feedback generation. The paper describes further steps necessary to evaluate and optimise this process in real classroom scenarios..

Description

Wolf, Karsten D.; Maya, Fatima; Heilmann, Lisanne (2024): Explainable Feedback for Learning Based on Rubric-Based Multimodal Assessment Analytics with AI. Proceedings of DELFI Workshops 2024. DOI: 10.18420/delfi2024-ws-40. Gesellschaft für Informatik e.V.

Keywords

ePortfolios, Explanatory Videos, Multimodal Formative Assessment, Large Language Models (LLM), Prompt Engineering, Few-Shot-Learning, Assessment Rubrics

Citation

Endorsement

Review

Supplemented By

Referenced By

Show citations