Early findings from a large-scale user study of CHESTNUT: Validations and implications

Peng, Xiangjun and Huang, Zhentao and Yang, Cheng and Song, Zilin and Sun, Xu (2020) Early findings from a large-scale user study of CHESTNUT: Validations and implications. In: 22th Springer International Conference on Human-Computer Interaction, 19-24 July 2020, Copenhagen, Denmark. (Unpublished)

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution.
Download (2MB) | Preview

Abstract

Towards a serendipitous recommender system with user-centred understanding, we have built CHESTNUT , an Information Theory-based Movie Recommender System, which introduced a more comprehensive understanding of the concept. Although off-line evaluations have already demonstrated that CHESTNUT has greatly improved serendip-ity performance, feedback on CHESTNUT from real-world users through online services are still unclear now. In order to evaluate how serendip-itous results could be delivered by CHESTNUT , we consequently designed , organized and conducted large-scale user study, which involved 104 participants from 10 campuses in 3 countries. Our preliminary feedback has shown that, compared with mainstream collaborative filtering techniques, though CHESTNUT limited users' feelings of unex-pectedness to some extent, it showed significant improvement in their feelings about certain metrics being both beneficial and interesting, which substantially increased users' experience of serendipity. Based on them, we have summarized three key takeaways, which would be beneficial for further designs and engineering of serendipitous recommender systems, from our perspective. All details of our large-scale user study could be found at https://github.com/unnc-idl-ucc/Early-Lessons-From-CHESTNUT

Item Type: Conference or Workshop Item (Paper)
Keywords: Serendipity; RecommederSystems; UserStudy
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
University of Nottingham Ningbo China > Faculty of Science and Engineering > Department of Mechanical, Materials and Manufacturing Engineering
Related URLs:
URLURL Type
https://www.researchgate.net/publication/338804926_Early_Findings_from_a_Large-scale_User_Study_of_CHESTNUT_Validations_and_ImplicationsUNSPECIFIED
Depositing User: Wu, Cocoa
Date Deposited: 21 May 2020 06:30
Last Modified: 21 May 2020 06:30
URI: http://eprints.nottingham.ac.uk/id/eprint/60668

Actions (Archive Staff Only)

Edit View Edit View