3D human tongue reconstruction from single “in-the-wild” images Stylianos Ploumpis1;2 * Stylianos Moschoglou1;2 * Vasileios Triantafyllou2 Stefanos Zafeiriou1;2 1Imperial College London, UK 2Huawei Technologies Co. Ltd 1fs.ploumpis,s.moschoglou,
[email protected] [email protected] Figure 1. We propose a framework that accurately derives the 3D tongue shape from single images. A high detailed 3D point cloud of the tongue surface and a full head topology along with the tongue expression can be estimated from the image domain. As we demonstrate, our framework is able to capture the tongue shape even in adverse “in-the-wild” conditions. Abstract dataset, consisting of 1; 800 raw scans of 700 individuals varying in gender, age, and ethnicity backgrounds *. As we 3D face reconstruction from a single image is a task demonstrate in an extensive series of quantitative as well that has garnered increased interest in the Computer Vision as qualitative experiments, our model proves to be robust community, especially due to its broad use in a number of and realistically captures the 3D tongue structure, even in applications such as realistic 3D avatar creation, pose in- adverse “in-the-wild” conditions. variant face recognition and face hallucination. Since the introduction of the 3D Morphable Model in the late 90’s, we witnessed an explosion of research aiming at particu- 1. Introduction larly tackling this task. Nevertheless, despite the increasing Recently, 3D face reconstruction from single “in-the- arXiv:2106.12302v1 [cs.CV] 23 Jun 2021 level of detail in the 3D face reconstructions from single wild” images has been a very active topic in Computer Vi- images mainly attributed to deep learning advances, finer sion with applications ranging from realistic 3D avatar cre- and highly deformable components of the face such as the ation to image imputation and face recognition [48, 17, 43, tongue are still absent from all 3D face models in the liter- 25, 41, 15].