Do calibrated recommendations affect explanations? A study on post-hoc adjustments
Loading...
Files
Published Version
Date
2025
Authors
Atauchi, Paul Dany Flores
Zanon, André Levi
da Rocha, Leonardo Chaves Dutra
Manzato, Marcelo Garcia
Journal Title
Journal ISSN
Volume Title
Publisher
Brazilian Computing Society
Published Version
Abstract
Recommender systems generate suggestions by identifying relationships among past interactions, user similarities, and item metadata. Recently, there has been an increased focus on evaluating recommendations based not only on accuracy but also on aspects like transparency and calibration. Transparency is important, as explanations can enhance user trust and persuasion, while calibration aligns users’ interests with recommendation lists, improving fairness and reducing popularity bias. Traditionally, calibration and explanation are applied in post-processing. Our study investigates two key research gaps: (1) the impact of graph embeddings in model-agnostic knowledge graph explanations, exploring their under-researched potential compared to syntactic approaches to produce meaningful explanations; and (2) the effect of calibration on recommendation explanations, assessing whether calibrated recommendation reordering influences the outcomes of explanation algorithms. We evaluate the quality of explanations using a set of metrics, such as diversity, which measures how well different interests of the user are covered; popularity, which assesses how well explanations avoid favoring already popular items; and recency, which examines the inclusion of recently interacted items. Our findings demonstrate that graph embedding methods are effective in generating high-quality explanations using these offline explanation metrics, and that post-hoc knowledge graph explanation algorithms are robust to calibration changes.
Description
Keywords
Calibration , Explanation , Graph Embeddings , Recommender Systems
Citation
Atauchi, P. D. F., Zanon, A. L., da Rocha, L. C. D. and Manzato, M. G. (2025) 'Do calibrated recommendations affect explanations? A study on post-hoc adjustments', Journal on Interactive Systems, 16(1), pp.441-460. https://doi.org/10.5753/jis.2025.5563