Capturing Detailed Deformations of Moving Human Bodies

Our method can capture over 1,000 unique points on the human body using only standard cameras and passive lights, without relying on temporal tracking or prior human body models.

We present a new method to capture detailed human motion, sampling more than 1000 unique points on the body. Our method outputs highly accurate 4D (spatio-temporal) point coordinates and, crucially, automatically assigns a unique label to each of the points. The locations and unique labels of the points are inferred from individual 2D input images only, without relying on temporal tracking or any human body shape or skeletal kinematics models.

Therefore, our captured point trajectories contain all of the details from the input images, including motion due to breathing, muscle contractions and flesh deformation, and are well suited to be used as training data to fit advanced models of the human body and its motion. The key idea behind our system is a new type of motion capture suit which contains a special pattern with checkerboard-like corners and two-letter codes.

Links:

• Paper PDF
• Project Page

Recommended citation: Anka He Chen, Hyojoon Park, Kutay Macit, Ladislav Kavan. (2021). "Capturing Detailed Deformations of Moving Human Bodies." ACM Transactions on Graphics 40(4).
Download Paper