Wang, Yaohua, Huang, Zhentao, Li, Rongze, Zhang, Zheng, Sun, Xu, Yin, Xinyu and Luo, Min
(2020)
A comparative study of speculative retrieval for multi-modal data trails: towards user-friendly Human-Vehicle interactions.
In: ICCAI 2020 6th International Conference on Computing and Artificial Intelligence, April 23-26, 2020, Tianjin, China.
(In Press)
Abstract
In the era of growing developments in Autonomous Vehicles, the importance of Human-Vehicle Interaction has become apparent. However, the requirements of retrieving in-vehicle drivers’ multi- modal data trails, by utilizing embedded sensors, have been consid- ered user unfriendly and impractical. Hence, speculative designs, for in-vehicle multi-modal data retrieval, has been demanded for future personalized and intelligent Human-Vehicle Interaction. In this paper, we explore the feasibility to utilize facial recog- nition techniques to build in-vehicle multi-modal data retrieval. We first perform a comprehensive user study to collect relevant data and extra trails through sensors, cameras and questionnaire. Then, we build the whole pipeline through Convolution Neural Net- works to predict multi-model values of three particular categories of data, which are Heart Rate, Skin Conductance and Vehicle Speed, by solely taking facial expressions as input. We further evaluate and validate its effectiveness within the data set, which suggest the promising future of Speculative Designs for Multi-modal Data Retrieval through this approach.
| Item Type: |
Conference or Workshop Item
(Paper)
|
| Keywords: |
Human-Vehicle Interaction; Facial Recognition; Multi-modal Data Streams |
| Schools/Departments: |
University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science |
| Related URLs: |
|
| Depositing User: |
Wu, Cocoa
|
| Date Deposited: |
21 May 2020 05:41 |
| Last Modified: |
21 May 2020 05:41 |
| URI: |
https://eprints.nottingham.ac.uk/id/eprint/60660 |
Actions (Archive Staff Only)
 |
Edit View |
Tools
Tools
