Detail Enhancement Program
Diffuman4D provides special optimization solutions for fine structures such as garment folds: 1) set the mode of clothing:detailed in config.yaml; 2) use the -high_freq parameter to enhance the high-frequency details; 3) use the multi-scale 4DGS algorithm in the reconstruction stage. In practice, it is recommended to: make sure the clothing area is well lit when shooting the input video; and additionally label the clothing key points on the basis of the MediaPipe skeleton.
Implementation steps
- Preparation phase: attaching reflective marking dots to key locations on the garment
- Generation phase: run python generate_views.py -cloth_detail
- Reconstruction phase: using scripts/refine_cloth.py post-processing scripts
parameter tuning
Recommended configuration: gaussian_bandwidth=0.05, texture_layers=4, for silk and other special materials can be enabled -specular parameter to enhance the reflective effect. Eventually, you can check the quality of the clothing area specifically through scripts/render_detail.py.
This answer comes from the articleDiffuman4D: Generating High-Fidelity 4D Human Body Views from Sparse VideoThe
