Item type:Conference Paper,

Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank

Loading...
Thumbnail Image

Fulltext URI

Document type

Text/Conference Paper

Additional Information

Date

relationships.isAuthorOf

Sipos, Lars
Schäfer, Ulrike
Glinka, Katrin
Müller-Birn, Claudia

Journal Title

Journal ISSN

Volume Title

Publisher

ACM

Abstract

Explainable Artificial Intelligence (XAI) is concerned with making the decisions of AI systems interpretable to humans. Explanations are typically developed by AI experts and focus on algorithmic transparency and the inner workings of AI systems. Research has shown that such explanations do not meet the needs of users who do not have AI expertise. As a result, explanations are often ineffective in making system decisions interpretable and understandable. We aim to strengthen a socio-technical view of AI by following a Human-Centered Explainable Artificial Intelligence (HC-XAI) approach, which investigates the explanation needs of end-users (i.e., subject matter experts and lay users) in specific usage contexts. One of the most influential works in this area is the XAI Question Bank (XAIQB) by Liao et al. The authors propose a set of questions that end-users might ask when using an AI system, which in turn is intended to help developers and designers identify and address explanation needs. Although the XAIQB is widely referenced, there are few reports of its use in practice. In particular, it is unclear to what extent the XAIQB sufficiently captures the explanation needs of end-users and what potential problems exist in the practical application of the XAIQB. To explore these open questions, we used the XAIQB as the basis for analyzing 12 think-aloud software explorations with subject matter experts, i.e., art historians. We investigated the suitability of the XAIQB as a tool for identifying explanation needs in a specific usage context. Our analysis revealed a number of explanation needs that were missing from the question bank, but that emerged repeatedly as our study participants interacted with an AI system. We also found that some of the XAIQB questions were difficult to distinguish and required interpretation during use. Our contribution is an extension of the XAIQB with 11 new questions. In addition, we have expanded the descriptions of all new and existing questions to facilitate their use. We hope that this extension will enable HCI researchers and practitioners to use the XAIQB in practice and may provide a basis for future studies on the identification of explanation needs in different contexts.

Description

Sipos, Lars; Schäfer, Ulrike; Glinka, Katrin; Müller-Birn, Claudia (2023): Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank. Mensch und Computer 2023 - Tagungsband. DOI: 10.1145/3603555.3608551. New York: ACM. pp. 492-497. MCI-POSTER. Rapperswil. 3.-6. September 2023

Keywords

Explainable AI,  Human-AI collaboration,  Explanation needs,  User study

Citation

Endorsement

Review

Supplemented By

Referenced By


Number of citations to item: 4

  • Ibrahim Mohammed, Basak Denizci Guillet (2025): Stakeholder perspectives on integrating explainable artificial intelligence into hotel revenue management system, In: Tourism Economics 4(32), doi:10.1177/13548166251382289
  • Ilka Hein, Sarah Diefenbach (2025): Towards a Comprehensive View on Technology Transparency: A Cross-Technology Investigation of Psychological and Design Factors Around Users’ Transparency Need and Perception, In: International Journal of Human–Computer Interaction 24(41), doi:10.1080/10447318.2025.2502983
  • Zaid M. Altukhi, Sojen Pradhan, Nasser Aljohani (2025): A Systematic Literature Review of the Latest Advancements in XAI, In: Technologies 3(13), doi:10.3390/technologies13030093
  • Lingqing Wang, Chidimma Lois Anyi, Kefan Xu, Yifan Liu, Rosa I. Arriaga, Ashok K. Goel (2025): Explainable AI for Daily Scenarios from End-Users’ Perspective: Non-Use, Concerns, and Ideal Design, In: Proceedings of the 2025 ACM Designing Interactive Systems Conference, doi:10.1145/3715336.3735796
Please note: Providing information about citations is only possible thanks to to the open metadata APIs provided by crossref.org and opencitations.net. These lists may be incomplete due to unavailable citation data.source: opencitations.net, crossref.org