Improving User’s Confidence to Act When Using Advice Algorithms Through Interactive Use of Counterfactuals

Authors Jeroen van Grondelle, Marlies van Steenbergen, Aletta Smits, Marcel Stalenhoef, Koen van Turnhout, Tijs Timmerman, Harald Pol
Published in Conference Proceedings 37th Bled eConference
Publication date 9 juni 2024
Research groups Betekenisvol Digitaal Innoveren
Type Lecture


In this paper, we explore the design of web-based advice robots to enhance users' confidence in acting upon the provided advice. Drawing from research on algorithm acceptance and explainable AI, we hypothesise four design principles that may encourage interactivity and exploration, thus fostering users' confidence to act. Through a value-oriented prototype experiment and value-oriented semi-structured interviews, we tested these principles, confirming three of them and identifying an additional principle. The four resulting principles: (1) put context questions and resulting advice on one page and allow live, iterative exploration, (2) use action or change oriented questions to adjust the input parameters, (3) actively offer alternative scenarios based on counterfactuals, and (4) show all options instead of only the recommended one(s), appear to contribute to the values of agency and trust. Our study integrates the Design Science Research approach with a Value Sensitive Design approach.

Downloads en links

On this publication contributed

Language Engels
Published in Conference Proceedings 37th Bled eConference
ISBN/ISSN URN:ISBN: 978-961-286-871-0
Key words advice robot, confidence to act, interactive, design science research, value sensitive design
Digital Object Identifier 10.18690/um.fov.4.2024.12

Jeroen van Grondelle

Jeroen van Grondelle

Jeroen van Grondelle

  • Onderzoeker
  • Research group: Betekenisvol Digitaal Innoveren