TRR 318-2 - Project A02: Monitoring the understanding of explanations

Our goal is to build a computational architecture that will monitor a human interlocutor’s moments of (non)understanding in multimodal ensembles. We will make artificial EXs able to reason about these and adapt their explanatory strategy. Utilizing a large corpus of explanations (MUNDEX), we integrate rich, multimodal signals with different perspectives on EE’ level of understanding across varying contexts. Beyond modeling the monitoring and adaptation in explanations, we assess its usefulness for a dynamically adjustable social XAI.