Artful Intelligence | Ep 3: Paul Trillo on Music Video x AI episode artwork

EPISODE · Dec 18, 2024 · 56 MIN

Artful Intelligence | Ep 3: Paul Trillo on Music Video x AI

from Possible · host Reid Hoffman

What does it take to create something the world has never seen before? In this final episode of Artful Intelligence, Reid Hoffman and Chris McLeod explore what it takes to spark a creative revolution with filmmaker Paul Trillo. Using OpenAI’s groundbreaking AI video generator, Sora, Paul directed the world’s first fully AI-generated music video.  After gaining early access to Sora, Paul faced a massive creative challenge: How could he use an AI tool known for surreal, dream-like visuals to craft a music video that felt emotionally real? The answer came from embracing AI’s quirks—its strange hallucinations, its unpredictable transformations—and writing prompts like poetic scripts to guide the machine’s creative output. Join us as Paul reveals how he turned an experimental AI model into an award-winning music video—and how creators everywhere can harness emerging tech to redefine what’s possible in art. Time Stamps: Part 1: To Create a Paradigm Shift with AI, Lean Into Its Constraints 07:25 - Paul Trillo discovers OpenAI’s AI video generator, Sora 09:46 - Navigating early uncertainty about AI’s impact on filmmaking 12:09 - Directing under creative constraints during COVID with The Shins’ “The Great Divide” 16:57 - Making emotionally resonant art despite technological limits 19:09 - Reid: What advice would you give someone running into constraints with AI tools? Part 2: Paradigm Shifts Often Come from Reviving Old, Impossible Ideas 23:01 - Paul’s early experiments with Sora push AI video limits 24:34 - Resurrecting old creative concepts from his “Graveyard of Ideas” 25:59 - Inspired by Carl Sagan’s “Golden Record” and its sci-fi storytelling potential 28:49 - Creating a surreal AI-generated trailer blending historical and futuristic imagery 30:21 - Revisiting a decade-old “infinite zoom” concept for a music video 35:05 - Reid: How do paradigm shifts in AI go beyond just replicating older tech? Part 3: Excavating Right at the Edge of What’s Possible Today 37:45 - Writing “alchemy-like” prompts to guide AI’s hallucinations 40:19 - Blending AI’s surreal misremembered details into an emotional story 42:36 - Generating 700 videos and 320 minutes of AI footage for the music video 44:56 - Reid: What kind of impossible ideas might AI make possible? Links: “The Hardest Part” Music Video by Washed Out. Directed by Paul Trillo: https://vimeo.com/941713443 “The Golden Record” by Paul Trillo: https://vimeo.com/927400626 “The Great Divide” by The Shins. Directed by Paul Trillo: https://vimeo.com/461473136 Infinite Zoom in Manhattan: https://vimeo.com/paultrillo Paul Trillo on Instagram: https://www.instagram.com/paultrillo Will Smith eating Spaghetti (example of early AI video generation):  https://www.youtube.com/watch?v=XQr4Xklqzw8 Reid AI: https://www.linkedin.com/posts/reidhoffman_the-nobel-prize-award-ceremony-took-place-activity-7272418124639928320-ZyMn/  Show Description: Artful Intelligence explores the thrilling intersection of creativity and artificial intelligence. Hosted by Chris McLeod, this mini-series dives into the stories of groundbreaking artists using AI to push the boundaries of what’s possible. Each episode showcases how human ingenuity and machine learning collaborate to create the extraordinary. With thought-provoking contributions from Reid Hoffman, Artful Intelligence asks bold questions about the future of creativity: Can AI amplify human expression? How do we ensure it empowers rather than replaces us?

What does it take to create something the world has never seen before? In this final episode of Artful Intelligence, Reid Hoffman and Chris McLeod explore what it takes to spark a creative revolution with filmmaker Paul Trillo. Using OpenAI’s groundbreaking AI video generator, Sora, Paul directed the world’s first fully AI-generated music video.  After gaining early access to Sora, Paul faced a massive creative challenge: How could he use an AI tool known for surreal, dream-like visuals to craft a music video that felt emotionally real? The answer came from embracing AI’s quirks—its strange hallucinations, its unpredictable transformations—and writing prompts like poetic scripts to guide the machine’s creative output. Join us as Paul reveals how he turned an experimental AI model into an award-winning music video—and how creators everywhere can harness emerging tech to redefine what’s possible in art. Time Stamps: Part 1: To Create a Paradigm Shift with AI, Lean Into Its Constraints 07:25 - Paul Trillo discovers OpenAI’s AI video generator, Sora 09:46 - Navigating early uncertainty about AI’s impact on filmmaking 12:09 - Directing under creative constraints during COVID with The Shins’ “The Great Divide” 16:57 - Making emotionally resonant art despite technological limits 19:09 - Reid: What advice would you give someone running into constraints with AI tools? Part 2: Paradigm Shifts Often Come from Reviving Old, Impossible Ideas 23:01 - Paul’s early experiments with Sora push AI video limits 24:34 - Resurrecting old creative concepts from his “Graveyard of Ideas” 25:59 - Inspired by Carl Sagan’s “Golden Record” and its sci-fi storytelling potential 28:49 - Creating a surreal AI-generated trailer blending historical and futuristic imagery 30:21 - Revisiting a decade-old “infinite zoom” concept for a music video 35:05 - Reid: How do paradigm shifts in AI go beyond just replicating older tech? Part 3: Excavating Right at the Edge of What’s Possible Today 37:45 - Writing “alchemy-like” prompts to guide AI’s hallucinations 40:19 - Blending AI’s surreal misremembered details into an emotional story 42:36 - Generating 700 videos and 320 minutes of AI footage for the music video 44:56 - Reid: What kind of impossible ideas might AI make possible? Links: “The Hardest Part” Music Video by Washed Out. Directed by Paul Trillo: https://vimeo.com/941713443 “The Golden Record” by Paul Trillo: https://vimeo.com/927400626 “The Great Divide” by The Shins. Directed by Paul Trillo: https://vimeo.com/461473136 Infinite Zoom in Manhattan: https://vimeo.com/paultrillo Paul Trillo on Instagram: https://www.instagram.com/paultrillo Will Smith eating Spaghetti (example of early AI video generation):  https://www.youtube.com/watch?v=XQr4Xklqzw8 Reid AI: https://www.linkedin.com/posts/reidhoffman_the-nobel-prize-award-ceremony-took-place-activity-7272418124639928320-ZyMn/  Show Description: Artful Intelligence explores the thrilling intersection of creativity and artificial intelligence. Hosted by Chris McLeod, this mini-series dives into the stories of groundbreaking artists using AI to push the boundaries of what’s possible. Each episode showcases how human ingenuity and machine learning collaborate to create the extraordinary. With thought-provoking contributions from Reid Hoffman, Artful Intelligence asks bold questions about the future of creativity: Can AI amplify human expression? How do we ensure it empowers rather than replaces us?

NOW PLAYING

Artful Intelligence | Ep 3: Paul Trillo on Music Video x AI

0:00 56:57

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

rAIsing the bar Isha Karim “rAIsing the bar” is a female-run podcast series committed to broadening the AI conversation and sparking discussion around the ethics and controversies surrounding the field today. By making AI more accessible in such an interconnected world, we aspire to foster an interest in AI for as many people as possible. The Real World Ruqiya A Welcome to the interview series where we have discussions to diverse range of topics the world has to offer. These topics can range from anything about being an immigrant to environmental issues around us. This is an open space that explores different perspectives and possible solutions for problems the world presents. The FRONTLINE Dispatch FRONTLINE Editor-in-Chief and Executive Producer Raney Aronson-Rath sits down with journalists and filmmakers for probing conversations about the investigative journalism that drives each FRONTLINE documentary and the stories that shape our time.This work matters. At a time when deep-dive reporting is more vital than ever, your support ensures FRONTLINE can continue to hold power accountable. Join our community of supporters here by making a contribution to keep this work going. Produced by Joel Patterson at FRONTLINE’s headquarters at GBH and powered by PRX.The FRONTLINE Dispatch is made possible by the Abrams Foundation Journalism Initiative. Quiet: The Power of Introverts with Susan Cain Susan Cain / Panoply / Quiet Revolution Susan Cain, bestselling author of "Quiet: The Power of Introverts in a World That Can't Stop Talking," hosts this ten-part weekly series on parenting and teaching introverted children. Susan will dive into why quiet kids are unique and require different parenting and teaching methods from their extroverted peers. Susan and her expert guests will discuss how parents and schools can help introverts thrive, how social media allows quiet children to express themselves in ways that were never possible before, the neuroscience of introversion, and much more.

Frequently Asked Questions

How long is this episode of Possible?

This episode is 56 minutes long.

When was this Possible episode published?

This episode was published on December 18, 2024.

What is this episode about?

What does it take to create something the world has never seen before? In this final episode of Artful Intelligence, Reid Hoffman and Chris McLeod explore what it takes to spark a creative revolution with filmmaker Paul Trillo. Using OpenAI’s...

Can I download this Possible episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!