Engineering Realization of Consistency Maintenance
The Dual Appearance Module is a patented technology of DiffPortrait360, which solves the problems of "blurring" and "feature misalignment" in the back view generation through the cross-attention mechanism and feature space mapping. The implementation consists of two core components: 1) a ViT-based cross-view feature aligner, which ensures that hairstyles, accessories, and other elements remain geometrically coherent during rotation; and 2) a multi-scale texture migration network, which accurately projects frontal details to other angles.
Experimental data shows that the module can control the difference of face features between views within 3.2 LIPIS units (industry standard evaluation index), compared with the traditional single-pass method to improve 67%. In the Pexels test set, wearing glasses test samples show that the technology can correctly deal with the perspective deformation of the frame, to maintain the natural transition of the lens reflective effect. In particular, the developer pointed out that the module can be adapted to different art styles through dynamic weight adjustment, from ultra-realistic to cartoon rendering can maintain a consistent style.
This answer comes from the articleDiffPortrait360: Generate 360-degree head views from a single portraitThe
English 
简体中文 
日本語 
Deutsch 
Português do Brasil