eos: A lightweight header-only 3D Morphable Model fitting library in modern C++11/14.
eos is a tiny 3D Morphable Face Model fitting library that provides just the bare minimum to load a model and perform camera and shape fitting. It's written in modern C++11/14.
At the moment, it mainly provides the following functionality:
- MorphableModel class to represent a 3DMM (using OpenCVs
cv::Mat) - Our low-resolution, shape-only 3D Morphable Face Model (share/sfm_shape_3448.bin)
- Camera pose estimation, implementation of:
- the Gold Standard Algorithm for estimating an affine camera matrix, from Multiple View Geometry, Hartley & Zisserman
- a non-linear algorithm that directly estimates the pose angles and camera translation
- Shape fitting, implementation of the linear shape-to-landmarks fitting of O. Aldrian & W. Smith, Inverse Rendering of Faces with a 3D Morphable Model, PAMI 2013
- Expression fitting, and 6 linear expression blendshapes: anger, disgust, fear, happiness, sadness, surprise.
- Isomap texture extraction to obtain a pose-invariant representation of the face texture.
More information, features and sample code on Github
Documentation (doxygen)
License & contributions:
This code is licensed under the Apache License, Version 2.0
Contributions are very welcome! (best in the form of pull requests.) Please use Github issues for any bug reports, ideas, and discussions.
If you use this code in your own work, please cite the following paper: A Multiresolution 3D Morphable Face Model and Fitting Framework, P. Huber, G. Hu, R. Tena, P. Mortazavian, W. Koppen, W. Christmas, M. Rätsch, J. Kittler, International Conference on Computer Vision Theory and Applications (VISAPP) 2016, Rome, Italy [PDF].