Key Considerations::
hardware limitation
- Insufficient video memory can cause generation interruptions:
- 32 fps sequence requires ≥30GB video memory
- Full NeRF needs to be ≥80GB - Linux is required, Windows runs on WSL.
Input Requirements
- Image resolution ≥ 512px is recommended, low resolution input will result in missing details
- Extreme lighting conditions (e.g. strong backlighting) may affect the quality of backside generation
- Need to manually adjust ROI when non-face area is over-represented
Functional boundaries
- The current version only supports head generation, the full body model needs to be used with other tools.
- Dynamic expression changes require additional timing control module
- The training code is not yet publicly available, and can only reason using pre-trained models
It is recommended to validate the process with the Pexels test data provided with the project for the first time before processing custom images. If you encounter video memory problems, you can try to lower the--num_frames
Parameter values.
This answer comes from the articleDiffPortrait360: Generate 360-degree head views from a single portraitThe