X-Dyna's Assessment System and the Value of Democratizing Technology
X-Dyna project not only open source the core code, more importantly, provides a complete set of video animation quality assessment system, which has a benchmark significance in the current open source community. The system contains DTFVD (dynamic time fluency index), Face-Cos (facial features retention), Face-Det (key point detection accuracy) and FID (generation quality indicators) four core evaluation dimensions. Among them, DTFVD is specifically designed for the smoothness of action transitions between consecutive frames and is computed using an optical flow consistency algorithm; Face-Cos quantifies the degree of retention of facial features through a pre-trained FaceNet model. The project not only provides evaluation scripts, but also open-sources a benchmarking dataset that allows researchers to reproduce the 0.91 DTFVD score reported in the paper. This complete toolchain has greatly lowered the technical barrier to entry into the field, and according to GitHub has led to the creation of 23 spin-off research projects.
This answer comes from the articleX-Dyna: Static Portrait Reference Video Pose Generation Video to Make Missy's Photos DanceThe
