Today in Generative Media

Meta AI's Movie Gen; Investors love ElevenLabs; Sora co-lead moves to Google

News and Opinion

• Movie Gen sets a new standard for immersive AI content (Meta AI)

  • Meta’s Movie Gen Makes Convincing AI Video Clips (Wired)

• Investors are scrambling to get into ElevenLabs, which may soon be valued at $3 billion (TechCrunch)

• A co-lead on Sora, OpenAI’s video generator, has left for Google (TechCrunch)

• Confessions of an illustrator: How I really feel about AI (Creative Bloq)

• I spoke to a 60-year-old AI version of myself and it was…. unsettling (Popular Science)

• Online spaces are rife with toxicity. Well-designed AI tools can help clean them up (The Conversation)

Software

• Introducing canvas A new way of working with ChatGPT to write and code (OpenAI)

• Google Lens now lets you search with video (The Verge)

• Gemini Live will support more languages for its AI voice chat (The Verge)

• I'm beyond excited to announce our new Avatar Looks feature at HeyGen! … Change up your backgrounds, outfits, stances, and camera angles to make your videos more engaging than ever before. (X)

• Fragments by E2B: This is an open source version of Anthropic's Claude Artifacts, Vercel v0 and GPT Engineer (GitHub)

Research

• Rejection Sampling IMLE: Designing Priors for Better Few-Shot Image Synthesis (ECCV 2024, project page)

• Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats (ECCV 2024, project page)

• Depth Pro: Sharp Monocular Metric Depth in Less Than a Second (arXiv). Code on GitHub

• Self-Supervised Audio-Visual Soundscape Stylization (project page)

• ComfyGen: Prompt-Adaptive Workflows for Text-to-Image Generation (project page)

Misc

• ChatGPT's new canvas interface is a game changer. Just used it to create a tesseract/hypercube visualizer with ThreeJS. (X)

• If you suffix a simple prompt to a filename, you can guide the Flux Pro output to something you want without losing the realism: (X)

• Hollywood is angry with us (X)

• We’re looking for industry-leading talent to help develop film, television and experimental new media projects. Screenwriters, animators, VFX artists, creative producers - if you know how to tell stories and can leverage technology to do so, we want to talk. (X)

• Runway NYC Meetup Tuesday, Oct 8 7:30pm – 9:30pm

• Artefact AI Film Festival: 129 films in competition

• AI ragdoll (X)