A comparative study of speculative retrieval for multi-modal data trails: towards user-friendly Human-Vehicle interactions

Wang, Yaohua, Huang, Zhentao, Li, Rongze, Zhang, Zheng, Sun, Xu, Yin, Xinyu and Luo, Min (2020) A comparative study of speculative retrieval for multi-modal data trails: towards user-friendly Human-Vehicle interactions. In: ICCAI 2020 6th International Conference on Computing and Artificial Intelligence, April 23-26, 2020, Tianjin, China. (In Press)

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution.
Download (911kB) | Preview


In the era of growing developments in Autonomous Vehicles, the importance of Human-Vehicle Interaction has become apparent. However, the requirements of retrieving in-vehicle drivers’ multi- modal data trails, by utilizing embedded sensors, have been consid- ered user unfriendly and impractical. Hence, speculative designs, for in-vehicle multi-modal data retrieval, has been demanded for future personalized and intelligent Human-Vehicle Interaction. In this paper, we explore the feasibility to utilize facial recog- nition techniques to build in-vehicle multi-modal data retrieval. We first perform a comprehensive user study to collect relevant data and extra trails through sensors, cameras and questionnaire. Then, we build the whole pipeline through Convolution Neural Net- works to predict multi-model values of three particular categories of data, which are Heart Rate, Skin Conductance and Vehicle Speed, by solely taking facial expressions as input. We further evaluate and validate its effectiveness within the data set, which suggest the promising future of Speculative Designs for Multi-modal Data Retrieval through this approach.

Item Type: Conference or Workshop Item (Paper)
Keywords: Human-Vehicle Interaction; Facial Recognition; Multi-modal Data Streams
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
Related URLs:
Depositing User: Wu, Cocoa
Date Deposited: 21 May 2020 05:41
Last Modified: 21 May 2020 05:41
URI: https://eprints.nottingham.ac.uk/id/eprint/60660

Actions (Archive Staff Only)

Edit View Edit View