Human behaviour-based automatic depression analysis using hand-crafted statistics and deep learned spectral features

Song, Siyang, Shen, Linlin and Valstar, Michel F. (2018) Human behaviour-based automatic depression analysis using hand-crafted statistics and deep learned spectral features. In: 13th IEEE International Conference on Face and Gesture Recognition (FG 2018), 15-19 May, Xi'an, China.

Full text not available from this repository.


Depression is a serious mental disorder that affects millions of people all over the world. Traditional clinical diagnosis methods are subjective, complicated and need extensive participation of experts. Audio-visual automatic depression analysis systems predominantly base their predictions on very brief sequential segments, sometimes as little as one frame. Such data contains much redundant information, causes a high computational load, and negatively affects the detection accuracy. Final decision making at the sequence level is then based on the fusion of frame or segment level predictions. However, this approach loses longer term behavioural correlations, as the behaviours themselves are abstracted away by the frame-level predictions. We propose to on the one hand use automatically detected human behaviour primitives such as Gaze directions, Facial action units (AU), etc. as low-dimensional multi-channel time series data, which can then be used to create two sequence descriptors. The first calculates the sequence-level statistics of the behaviour primitives and the second casts the problem as a Convolutional Neural Network problem operating on a spectral representation of the multichannel behaviour signals. The results of depression detection (binary classification) and severity estimation (regression) experiments conducted on the AVEC 2016 DAIC-WOZ database show that both methods achieved significant improvement compared to the previous state of the art in terms of the depression severity estimation.

Item Type: Conference or Workshop Item (Paper)
Additional Information: c2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Schools/Departments: University of Nottingham, UK > Faculty of Science > School of Computer Science
Related URLs:
Depositing User: Valstar, Michel
Date Deposited: 30 Apr 2018 09:58
Last Modified: 04 May 2020 19:36

Actions (Archive Staff Only)

Edit View Edit View