Zekun Wu will present a paper at ETRA’25 the Symposium on Eye Tracking Research & Applications in Tokyo, Japan.
RelEYEance: Gaze-based assessment of users’ AI-reliance at run-time
Zekun Wu, Yao Wang, Markus Langer, Anna Maria Feit
Abstract:
In time-critical detection tasks, such as drone monitoring, a key condition for users to effectively leverage AI assistance is to find an appropriate trade-off between making fast decisions and verifying AI suggestions, which we refer to as appropriate user reliance. However, assessing such reliance is often oversimplified by focusing solely on task outcomes, potentially overlooking whether users properly verify AI messages. We collected eye-tracking data from an AI-assisted monitoring task and developed a gaze-based reliance model: RelEYEance, to assess the extent of user reliance on AI-suggested alarms. We found that gaze patterns related to verification behaviors distinguish between appropriate reliance, over-reliance, and under-reliance, influencing task performance. We validated our model in a second user study, showing it can reliably detect users’ over- and under-reliance at run-time, which could be used e.g. for issuing intervention messages. The results demonstrate the potential for real-time human-AI reliance assessment, facilitating adaptive reliance calibration.
Paper: https://doi.org/10.1145/3725841
Code and Data: https://osf.io/8r5pt
Be First to Comment