This weekend in Generative Media

AI music companies hire elite lawyers; Creepy brand experiment; Flawless' AI dubbing

News

• AI Music Companies Suno and Udio Hire Elite Law Firm for Copyright Battle With Major Labels (Billboard)

• Creepy big brand experiment shows how far AI art has come (Creative Bloq)

• This AI Company Wants to Revolutionize How Dialogue Is Re-Dubbed Into Different Languages (Variety)

• VFX House DNEG Acquires AI-Company Prime Focus Technologies — Film News in Brief (Variety)

• Adobe’s Rani Mani Talks Team Gleason Partnership, Art As Accessibility, Generative AI In Interview (Forbes)

Software

• This page showcases DeepMake’s AI rotoscoping against other available tools using AI. (DeepMake)

• Introducing AuraFlow v0.1, an Open Exploration of Large Rectified Flow Models (fal.ai) Fun fact: AuraFlow was < 800 LoC and < one month of training (X)

• MASt3R – Matching And Stereo 3D Reconstruction (Naver Labs)

• supervision-0.22.0 is coming out today. One of the things we release is Mediapipe integration along with default visualizers for face and body pose keypoints (X)

• We introduce SEED-Story, a MLLM capable of generating multimodal long stories consisting of rich and coherent narrative texts, along with images that are consistent in characters and style... (GitHub)

• Next generation human motion estimation from video from Meshcapade. Just regular video, moving cameras, complex motions, any clothing, occlusion/truncation, finger movement, all in world coordinates -- it just works. (X)

Research

• Dynamic Gaussian Mesh: Consistent Mesh Reconstruction from Monocular Videos (project page)

• Live2Diff: Live Stream Translation via Uni-directional Attention in Video Diffusion Models (project page)

• Generalizable Implicit Motion Modeling for Video Frame Interpolation (project page)

• Generative Image as Action Models (project page)

• Still-Moving A Research Exploration into Customized Video Generation without Customized Video Data (project page)

• SRPose: Two-view Relative Pose Estimation with Sparse Keypoints (arXiv)

• MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions (arXiv)

Misc

• Tutorial on Diffusion Models for Imaging and Vision (arXiv)

• I Made a Movie with AI: Here's What I Learned (Jaclyn Konzelmann on Substack)

• Framestore - an Academy Award winning visual effects house - showcases the use of Gen-AI in the latest WWE 2K24 POV launch trailer. (LinkedIn)

• AI is getting out of hand (X)

• “Driving through a Parisian motorway” by u/viztape with RunwayML (X)