Estimating and evaluating the uncertainty of rating predictions and top-n recommendations in recommender systems
dc.contributor.author | Coscrato, Victor | |
dc.contributor.author | Bridge, Derek G. | |
dc.contributor.funder | Science Foundation Ireland | en |
dc.contributor.funder | European Regional Development Fund | en |
dc.date.accessioned | 2023-03-09T11:56:35Z | |
dc.date.available | 2023-03-09T11:56:35Z | |
dc.date.issued | 2023-02-16 | |
dc.date.updated | 2023-02-22T15:04:30Z | |
dc.description.abstract | Uncertainty is a characteristic of every data-driven application, including recommender systems. The quantification of uncertainty can be key to increasing user trust in recommendations or choosing which recommendations should be accompanied by an explanation; and uncertainty estimates can be used to accomplish recommender tasks such as active learning and co-training. Many uncertainty estimators are available but, to date, the literature has lacked a comprehensive survey and a detailed comparison. In this paper, we fulfil these needs. We review the existing methods for uncertainty estimation and metrics for evaluating uncertainty estimates, while also proposing some estimation methods and evaluation metrics of our own. Using two datasets, we compare the methods using the evaluation metrics that we describe, and we discuss their strengths and potential issues. The goal of this work is to provide a foundation to the field of uncertainty estimation in recommender systems, on which further research can be built. | en |
dc.description.sponsorship | Science Foundation Ireland (18/CRT/6223000) | en |
dc.description.status | Peer reviewed | en |
dc.description.version | Accepted Version | en |
dc.format.mimetype | application/pdf | en |
dc.identifier.articleid | 7 | en |
dc.identifier.citation | Coscrato, V. and Bridge, D. (2023) ‘Estimating and evaluating the uncertainty of rating predictions and top-n recommendations in recommender systems’, ACM Transactions on Recommender Systems, 1(2), pp. 1–34. Available at: https://doi.org/10.1145/3584021 | en |
dc.identifier.doi | https://doi.org/10.1145/3584021 | en |
dc.identifier.eissn | 2770-6699 | |
dc.identifier.endpage | 34 | en |
dc.identifier.journaltitle | ACM Transactions on Recommender Systems | en |
dc.identifier.startpage | 1 | en |
dc.identifier.uri | https://hdl.handle.net/10468/14296 | |
dc.identifier.volume | 1 | en |
dc.language.iso | en | en |
dc.publisher | Association for Computing Machinery | en |
dc.rights | © 2023, the Authors. Publication rights licensed to ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in ACM Transactions on Recommender Systems, https://doi.org/10.1145/3584021 | en |
dc.subject | Information systems | en |
dc.subject | Recommender systems | en |
dc.subject | Uncertainty | en |
dc.subject | Computing methodologies | en |
dc.subject | Uncertainty quantification | en |
dc.subject | General and reference | en |
dc.subject | Empirical studies | en |
dc.subject | Evaluation | en |
dc.subject | Estimation | en |
dc.subject | Mathematics of computing | en |
dc.subject | Probability and statistics | en |
dc.subject | Uncertainty | en |
dc.subject | Recommender systems | en |
dc.title | Estimating and evaluating the uncertainty of rating predictions and top-n recommendations in recommender systems | en |
dc.type | Article (peer-reviewed) | en |