Today in Generative Media

Culture war meets AI tech; X is spreading AI porn; What was Sora trained on?

• AI Companies Are Getting the Culture War They Deserve (Intelligencer)

• Bobbi Althoff deepfake spotlights X’s role as a top source of AI porn (Washington Post)

• What was Sora trained on? Creatives demand answers. (Mashable)

• Gemini image generation got it wrong. We'll do better. (Google Keyword blog)

• Creators vs. Artists (Rei Inamoto on Substack)

• Unleash creativity with GoEnhance AI. Video to Video: Turn video into videos with many different styles. (GoEnhance.ai)

• We are launching IP Adapter on Scenario, here is a quick look and overview of what it is (Scenario.com)

• TTS Arena: Benchmarking TTS Models in the Wild (HuggingFace)

• FiT: Flexible Vision Transformer for Diffusion Model (GitHub)

• Visual Style Prompting with Swapping Self-Attention (project page)

• Cameras as Rays: Pose Estimation via Ray Diffusion (ICLR 2024, project page)

• Symbolic Music Generation with Non-Differentiable Rule Guided Diffusion (project page)

• ToDo: Token Downsampling for Efficient Generation of High-Resolution Images (arXiv)

• GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians (arXiv)

• Just discovered Vizcom yesterday. Using Three.js under the hood, you can drop a GLB and position it as the "sketch". Then, drop a reference image and you are done. You can use "refine" to replace anything you want in real time. Mind blowing. 🤯 (X)

• SDXL Lightning WebSocket Streaming, but in Comfy UI. Coming to Comfy Deploy soon. Websocket will be available to all normal workflow. (X)

• We want to make a large open Stable Video 2 similar to Sora but need more data & compute (hmu for collabs 🤙) To that end happy to open up stablevideo.com to all. (X)

• Considering the amount of talent we have in the #AIfilm community, has it dawned on anyone else that maybe we should start our own production studio?! (X)

• If you gave the average Netflix subscriber either 1) the ability to generate a movie/show by typing a few sentences or 2) a list of recommended generations, I think most would choose 2. (X)