SynthLight is an AI-based portrait relighting tool designed to adjust the lighting effects of real portraits. Its core function is to relight portraits from ambient light maps, generating realistic effects that include natural highlights and projections, while keeping the identity of the subject unchanged.
The technical principle contains three main innovations:
- Generate training datasets using a physical rendering engine to simulate image transformations under various lighting conditions
- Image processing is performed using a diffusion model, which learns the re-rendering process of a synthetic face to achieve the lighting effect migration
- Combining multi-task training strategies to improve model generalization using real portrait data without light labels
SynthLight features "never-before-seen" lighting effects compared to traditional light editing tools, thanks to its deep learning approach based on large amounts of physical rendering data.
This answer comes from the articleSynthLight: natural light rendering of portrait images (unreleased)The