Summary of Voodoo Xp: Expressive One-shot Head Reenactment For Vr Telepresence, by Phong Tran et al.
VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence
by Phong Tran, Egor Zakharov, Long-Nhat Ho, Liwen Hu, Adilbek Karmanov, Aviral Agarwal, McLean Goldwhite, Ariana Bermudez Venegas, Anh Tuan Tran, Hao Li
First submitted to arxiv on: 25 May 2024
Categories
- Main: Computer Vision and Pattern Recognition (cs.CV)
- Secondary: Artificial Intelligence (cs.AI); Graphics (cs.GR)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary A novel 3D-aware one-shot head reenactment method, VOODOO XP, is introduced for generating highly expressive facial expressions from input driver videos and single 2D portraits. This real-time solution preserves subject identity and ensures view-consistent facial geometry, making it suitable for immersive applications. Unlike previous methods, VOODOO XP transfers the driver’s facial expressions to transformer blocks using a cross-reenactment architecture and achieves state-of-the-art performance in expressiveness and likeness preservation. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary VOODOO XP is a new way to make videos look like someone else. It takes a video of someone’s face and turns it into a 3D animation that looks super real! The idea is to make it seem like the person in the video is actually there, talking to you. This could be really useful for things like video conferencing or virtual reality games. |
Keywords
» Artificial intelligence » One shot » Transformer
