Core solution steps
The backside distortion mainly stems from the lack of backside feature data, and a dual optimization strategy is recommended:
- ControlNet enhancements: Enable inference.sh
--use_controlnet
parameters, the module generates physically plausible dorsal structures for hair, ears, etc. by inferring geometric symmetry - Reference Chart Guidance: Place both the front view and 1-2 side and rear angle reference images (45°/90°) in the input_image/ directory, and the model will be feature fused by the dual appearance module
advanced skill
For special elements (glasses/hats):
- Use the project-supplied
accessory_mask.py
Script marking the accessory area - align
--texture_preservation
Parameters to 0.6-0.8 range to maintain material continuity - The generated results were analyzed using NeRFStudio's
--mesh_refine
Perform local mesh reconstruction
Typical cases show that this method can improve the backside PSNR metric by 421 TP3T.
This answer comes from the articleDiffPortrait360: Generate 360-degree head views from a single portraitThe