3D face and body reconstruction via volumetric regression networks

Tools

Jackson, Aaron S. (2019) 3D face and body reconstruction via volumetric regression networks. PhD thesis, University of Nottingham.

[thumbnail of thesis.pdf] PDF (Thesis - as examined) - Repository staff only - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (17MB)

Abstract

3D Face reconstruction is the process of estimating the full 3D geometry of a human's face from one or more images. Applications of 3D face reconstruction span many areas, from personalisation of video games and trying on accessories online, to measuring emotional arousal for psychological studies and in medicine, such as simulating the result of reconstructive surgery. Approaches to 3D face reconstruction generally depend on a 3D Morphable Model (3DMM) - a parametric model, where the shape, pose and expression can be adjusted using a small number of parameters. While methods based on such techniques can work well on frontal images, they often begin to fail on cases of large pose, difficult expression, occlusion, and bad lighting. Additionally, encoding detail in so few parameters is not possible.

In this thesis, we propose a novel approach to the problem of 3D face reconstruction: Volumetric Regression Networks. Our non-parametric approach constrains the problem to the spatial domain using an end-to-end network which directly regresses the 3D geometry using a volumetric representation. This avoids the need for 3DMM generation, which involves finding correspondence between all vertices of all training samples, but also the fitting stage, which requires solving a difficult optimisation problem. We demonstrate that doing so can not only provide state-of-the-art results, but also be adapted to other deformable objects, such as the full human body.

Item Type: Thesis (University of Nottingham only) (PhD)
Supervisors: Tzimiropoulos, Georgios
Valstar, Michel
Keywords: volumetric regression, deep learning, convolutional neural network, 3d reconstruction
Subjects: Q Science > QA Mathematics > QA 75 Electronic computers. Computer science
Faculties/Schools: UK Campuses > Faculty of Science > School of Computer Science
Item ID: 59121
Depositing User: Jackson, Aaron
Date Deposited: 29 Sep 2023 08:01
Last Modified: 29 Sep 2023 08:01
URI: https://eprints.nottingham.ac.uk/id/eprint/59121

Actions (Archive Staff Only)

Edit View Edit View