Shypd.aiThe largest open index of AI toolsGeneFace is an open-source AI tool that enables generalized and high-fidelity audio-driven 3D talking face synthesis. It provides a PyTorch implementation for generating realistic facial animations from audio inputs.
Trending
About
GeneFace is an official PyTorch implementation of the ICLR-2023 paper on Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis. This open-source tool allows users to generate realistic 3D talking faces from audio, offering improved lip synchronization and expressiveness, even with out-of-domain audios. The project provides pre-trained models and processed datasets for a quick start, along with detailed guides for environment setup, data preparation, and model training. GeneFace has seen significant updates, including a real-time RAD-NeRF-based renderer, a faster PyTorch-based deep3d_reconstruction module, and a pitch-aware audio2motion module for more accurate lip-sync landmarks. It also offers the flexibility to train models on custom target person videos.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
