Fusing deep learned and hand-crafted features of appearance, shape, and dynamics for automatic pain estimation

Egede, Joy Onyekachukwu and Valstar, Michel F. and Martinez, Brais (2017) Fusing deep learned and hand-crafted features of appearance, shape, and dynamics for automatic pain estimation. In: 12th IEEE Conference on Face and Gesture Recognition (FG 2017), 30 May-3 June 2017, Washington, D.C., U.S.A..

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (466kB) | Preview

Abstract

Automatic continuous time, continuous value assessment of a patient's pain from face video is highly sought after by the medical profession. Despite the recent advances in deep learning that attain impressive results in many domains, pain estimation risks not being able to benefit from this due to the difficulty in obtaining data sets of considerable size. In this work we propose a combination of hand-crafted and deep-learned features that makes the most of deep learning techniques in small sample settings. Encoding shape, appearance, and dynamics, our method significantly outperforms the current state of the art, attaining a RMSE error of less than 1 point on a 16-level pain scale, whilst simultaneously scoring a 67.3% Pearson correlation coefficient between our predicted pain level time series and the ground truth.

Item Type: Conference or Workshop Item (Paper)
Additional Information: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
University of Nottingham, UK > Faculty of Science > School of Computer Science
Related URLs:
Depositing User: Valstar, Michel
Date Deposited: 27 Feb 2017 13:31
Last Modified: 28 Jun 2017 22:39
URI: http://eprints.nottingham.ac.uk/id/eprint/40801

Actions (Archive Staff Only)

Edit View Edit View