Shape of You: Precise 3D shape estimations for diverse body types

14 Apr 2023  ·  Rohan Sarkar, Achal Dave, Gerard Medioni, Benjamin Biggs ·

This paper presents Shape of You (SoY), an approach to improve the accuracy of 3D body shape estimation for vision-based clothing recommendation systems. While existing methods have successfully estimated 3D poses, there remains a lack of work in precise shape estimation, particularly for diverse human bodies. To address this gap, we propose two loss functions that can be readily integrated into parametric 3D human reconstruction pipelines. Additionally, we propose a test-time optimization routine that further improves quality. Our method improves over the recent SHAPY method by 17.7% on the challenging SSP-3D dataset. We consider our work to be a step towards a more accurate 3D shape estimation system that works reliably on diverse body types and holds promise for practical applications in the fashion industry.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Human Shape Estimation SSP-3D SoY PVE-T-SC 15.8 # 4
mIOU 76 # 2

Methods


No methods listed for this paper. Add relevant methods here