Three Recipes for Better 3D Pseudo-GTs of 3D Human Mesh Estimation in
the Wild
Three Recipes for Better 3D Pseudo-GTs of 3D Human Mesh Estimation in the Wild
Gyeongsik Moon Hongsuk Choi Sanghyuk Chun Jiyoung Lee Sangdoo Yun

Abstract
Recovering 3D human mesh in the wild is greatly challenging as in-the-wild(ITW) datasets provide only 2D pose ground truths (GTs). Recently, 3Dpseudo-GTs have been widely used to train 3D human mesh estimation networks asthe 3D pseudo-GTs enable 3D mesh supervision when training the networks on ITWdatasets. However, despite the great potential of the 3D pseudo-GTs, there hasbeen no extensive analysis that investigates which factors are important tomake more beneficial 3D pseudo-GTs. In this paper, we provide three recipes toobtain highly beneficial 3D pseudo-GTs of ITW datasets. The main challenge isthat only 2D-based weak supervision is allowed when obtaining the 3Dpseudo-GTs. Each of our three recipes addresses the challenge in each aspect:depth ambiguity, sub-optimality of weak supervision, and implausiblearticulation. Experimental results show that simply re-trainingstate-of-the-art networks with our new 3D pseudo-GTs elevates their performanceto the next level without bells and whistles. The 3D pseudo-GT is publiclyavailable in https://github.com/mks0601/NeuralAnnot_RELEASE.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 3d-multi-person-human-pose-estimation-on | 3DCrowdNet | 3DPCK: 76.2 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.