Welcome to the podcast, I'm your host Jaden Schaefer. Today on the show, I want to talk about some updates in AI audio. We have a couple new features from a bunch of big companies rolling out from Spotify. They're rolling out new AI-powered prompted playlists where you essentially create a prompt and it builds a Spotify playlist for you.
There's some interesting pros and cons to this. Particle is an AI news app that now is able to listen to podcasts for you. So like, you know, instead of just having to give you summaries on news from top news organizations based off articles, you can actually go listen to podcasts for you, pull out interesting clips from those podcasts, you can also listen to the entire thing. Personally, as an avid podcast listener, this is something I'm excited about.
And finally, Eleven Labs has written an entire report on the state of AI audio in publishing and news. So let's get into all of the AI audio news. But before we do, I have a major announcement that I'm super excited to make. And that is that my own platform, AIbox.ai, that lets you access over 50 different of the top AI models all in one place.
You don't have to have subscriptions to all of them. We've just completed an entire, redesigned the whole platform from the ground up and an entire overhaul. So if you've tried it in the past, I'd love for you to check it out. Today, you'd access in a playground to all of the top AI models.
And we have a vibe tool builder where you can describe any workflow or tool you'd like to create. And we link together all of the different AI models, input prompts for you, and build tools to help automate a lot of the stuff you do. We've simplified it a ton. I personally have spent weeks and hours painstakingly doing all of the UI to make this thing look amazing.
That's just kind of what I obsess about. And so if you enjoy it, let me know. And if you want any more features or things added to it, let me know. We just put a massive upgrade.
So if you want to check it out, it is AIbox.ai. And we also rolled out new pricing tiers. So you can actually get it. It was 20 bucks only in the past.
If you want to test it out and do some smaller scale stuff, we have an 899 tier. And we also have annual plans. So you get 20% discount if you get an annual plan as well. So go check it out, AIbox.ai.
All right, let's talk about the state of AI and audio. I want to kick this off talking about Spotify's new feature. And then just searching for different playlists, which is what I will typically do. It will use AI to create them from scratch.
Now, there's a bunch of pros and cons for this. And I mean, I'll automatically admit my bias in this. I've actually spent a decent amount of money invested into creating playlists and promoting them to get users to follow these playlists. And then if you have music that you put into that playlist, it automatically gets listened to.
So this is a good way to get music listened to. And obviously, you've got to make good stuff that follows inside of your genre that your followers will like. But doing these AI playlists essentially kind of kills off that entire industry or that entire way of making content. Now, if I'm being honest, I think that this is probably where the future goes in a way.
And that's because oftentimes, you know, as myself as someone that is a playlist creator or they call them playlist curators, I sometimes get really busy. I don't update my playlist for a month. And maybe there's a bunch of great songs that would have been perfect that the Spotify algorithm could have found that I didn't find. And so I think that's an interesting concept.
Now, will these playlists automatically be updated that you prompt? Probably not. So you also have to automatically prompt them. So the pros and cons here are that the user, while they will get a fresh playlist when they prompt it and create something cool that maybe a playlist curator if they were on top of it, I wouldn't have added.
You also have to continuously kind of re-prompt or regenerate that playlist to keep it fresh if you wanted new stuff in there. So possibly that's actually just making more work for the user. So pros and cons there. Besides that, I think there's a bunch of cool things you can do in the prompting itself.
You can add things like the vibe, different scenarios, aesthetics, memory area, era, genre. You can say something like songs that feel like the final score of a specific movie. And you can also ask for mostly new music or you can ask for mostly music from your library. So there's a whole bunch of really cool things there.
I'll give you one example that I saw in a Spotify demo. They said, find one artist I haven't listened to yet but would probably love and an artist I've only heard one or two songs from and introduced me to them. Build a playlist of songs that will give me an overview of their catalog so it feels like I'm getting to know them, put the songs you think I like most in the top spots. So you type in something pretty long and elaborate and specific like this and it generates it for you.
Now, I think this is awesome for reading custom music exactly how you want. The only downside is it's super cool to get this review to customize your algorithm basically and actually get to the correct direction but also something that the user kind of kills me to be like, man, why can't they just like make like a, I don't know, like some sort of button that I push and it automatically does that for me. Like if there's something people are frequently putting these huge long prompts or I don't want to have to be a quote unquote prompt engineer or someone that has like these giant saved prompts in the notes app on my phone that I got to copy and paste into Spotify every time I want to get like this new fancy playlist. So that's just maybe, yeah, that's just me maybe complaining but I really just wish the algorithm would automatically do most of the stuff for me because I don't want more work.
I don't want to copy and paste every time I want a fresh Spotify playlist. But you know, it's probably way less work than going manually finding songs and finding playlists perhaps so there's, you know, pros and cons. This is still in beta. I think a lot of users say that they're hitting caps after about 20 to 30 prompts so you get 20 to 30 prompts in and it's not going to let you do anything.
I think Spotify is managing costs and they're also trying to learn what kind of prompts are creating like the highest satisfaction, right? I think if people are doing 20 to 30 they're probably not getting what they want and I probably would need like four different playlists and I could be happy for life but maybe that's just me. All right, let's talk about what Particle is doing. So they're an AI news app.
They're built by some former Twitter engineers. They're now treating podcasts kind of like a first class news source, not a separate medium that you go to. And I think this is interesting, right? They have a new feature which is called podcast clips and it basically finds interesting moments inside of podcasts and it puts those clips alongside related news stories in their news feed and I think basically what they're saying is that you shouldn't have to listen to an hour long episode just to find 45 seconds that actually matter.
Actually, I think this is really cool. As someone that creates obviously a lot of podcast content, I host a lot of podcasts, I listen to a lot of podcasts. I think this is awesome. There's certain podcasts I listen to every week for example and they're like one or two hours long and sometimes I just don't have the time to catch up but it would be sweet to just be able to go and say like, hey, you know, like the five top things happened, the top moments, the things that were said and some of those podcasts really do break news or give you insights that you can't get anywhere else because of people working on, you know, businesses inside of organizations.
So like there's really good juicy data in there, valuable stuff and if I got, you know, an hour long drive to work, an hour long drive back, I'll get through that, no problem. But sometimes I don't have to go to work or sometimes I don't have to do that long drive or I don't have a long flight and it'd be really nice to people to just get the highlights. So do think that that's very, very cool. They are wrapping this inside of a product strategy that is pretty familiar and that's just basically a premium plus subscription.
So if you get particle plus, it's $2.99 a month or about $30 a year and then you get all of those kind of summary controls, you get multiple voices for audio feed, you can listen to the news, there's a bunch of other cool premium features but they do have some, you know, some elements of that that are paid. Next up, let's talk about what's going on over at 11 Labs, one of my favorite AI audio companies, although they are so expensive that it kills me sometimes but I have spent thousands of dollars, I might be getting close to $10,000 of 11 Labs credits I've spent all over my life so obviously I love this company but I have a lovely relationship because it doesn't feel good to have spent $10,000 on a company in AI. But the places at 11 Labs I think are really crushing it lately and also like full disclosure, this is something I spend a lot of money on as well, is in things like audio dubbing. So recently I've had AI Chat, AI Hustle, AI Applied, three of my top podcasts all translated with dubbing via 11 Labs into a whole bunch of different languages so people can listen to this podcast in French, Spanish, German, Mandarin, like a whole bunch of different languages but it's still my voice talking.
So I think that's a really cool feature that 11 Labs enables and you have to do a bunch of creative things especially if there's two different voices. You have to, you know, first take the voices and clone the voices, then you have to determine, you know, which voice is which so you have to identify who the two speakers are and kind of do those two voice clones separate. You have to do the translation of course which isn't too crazy but then something that 11 Labs does that I'm impressed by is in order to get the lip sync working, meaning if you're going to use like an audio that gets translated for a movie, right, let's say the movie clip is 30 seconds long, you don't want the audio file to come out after it gets translated into Spanish as like 45 seconds. And now because every word and every translation and phrase could be shorter or longer, it is pretty tricky to do this but there are a bunch of like stretching tools and techniques that you can use and so this is kind of what 11 Labs does.
So essentially if you, you can use these audio files as dubs for videos and you see kind of the same technology with like HeyGens and people like that but I've been really impressed with how 11 Labs has done it and specifically, you know, I use this for podcasting and a lot of other publishers and news organizations are also doing this and this is a really big money maker for 11 Labs. I think this is going to be a trend we see more and more into the future which I'm pretty excited about. I think AI is showing up everywhere all at once, it doesn't just kind of make things more convenient, I think it really kind of changes how we consume media whether that's podcasts, articles or music so I'm really excited about a lot of the advances we made in all three of those areas. I think the next phase is pretty obvious, you can kind of see where this is going if you look at the roadmap and that's language, I think conversational audio, interruptible voice experiences and then also kind of interactive news where the story is not just a page you read, it's kind of like a conversation that you're having with the news, I think these are some of these use cases how they expand.
A concept I've been thinking a lot about lately is that it's not just about who has the best AI model per se and that's who's going to win in this, I think it's who can come up with the best use cases, I think there's so many interesting plays that can be made right now, especially with all of the advancements we're seeing in AI and audio. Thank you so much everyone for tuning in to the podcast today, if you enjoyed this episode make sure to leave a rating and review wherever you get your podcasts, it helps the show out a ton, honestly, it's like the number one way if you ever get anything out of the show you can say thank you, drop a comment or leave some stars over on Spotify, it helps the show a ton to get found by new people which is big, but also I really appreciate them, I read all the reviews, helps me know what you guys like to hear and what's helpful for you all, so if you want to drop a review I would be super super grateful, thanks so much make sure to check out AIbox.ai to get access to all of the different AI models in one place and check out my new redesign, I'd love to hear what you guys think of it, it has been a labor of love with blood, sweat, and tears, but I think it looks amazing, so I'd love to hear what you guys think, alright catch you guys all in the next episode.