Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI-related tech is changing the world, this is the show for you. Thank you to our partners at Fly.io. Fly transforms containers into micro VMs that run on their hardware in 30-plus regions on six continents, so you can launch your app near your users. Learn more at Fly.io.
What's up, friends? Intel Innovation 2024 is right around the corner. Accelerate the future. Registration is now open, and it takes place September 24th and 25th in San Jose, California. This event is all about you, the developer, the community, and the critical role you play in tackling the toughest challenges across the industry. Ignite your passion for AI and beyond. Grow your skills to maximize your impact and network with your peers as they unleash the next wave of advancements in technology. Here's what you can expect. Understand the emerging innovation and trends in dev tools, languages, frameworks, and technologies in AI and beyond to empower you and the solutions you're building.
Get in-depth technical experience doing hands-on workshops, labs, meetups, and hackathons to collaborate and solve problems in real time. You can explore featured partner and Intel solutions. They have partners there, startups there, customers there. And Intel is showcasing the latest in products, services, and solutions across keynotes, tech sessions, and the show floor to help you meet your development needs. Collaborate with experts, learn and have fun, engage in interactive sessions to connect, get certified, gain unique ideas and perspectives, build long-lasting networks, and of course...
Have fun and get inspired. Hear from leading industry experts, technologists, startup entrepreneurs and fellow developers, along with Intel leadership, CEO Pat Gelsinger and CTO Greg Lavender as they take you through the latest advancements in technology. Don't miss this chance to be at the forefront of innovation. Take advantage of early bird pricing right now until August 2nd. Register using the link in our show notes or to learn more, go to intel.com slash innovation. Once more, that's intel.com slash innovation or go to the show notes and click that link.
Well, welcome to another episode of Craftical AI. This is Daniel Whitenack. I am founder and CEO at Prediction Guard. I'm joined as always by my co-host, Chris Benson, who is a principal AI research engineer. at Lockheed Martin. How you doing, Chris? I'm doing fine. We got a fun one today, Daniel. Let's give you a good one. Yes, of course. It was wonderful not that long ago to be in the great city of San Francisco and run into our friend Dimitrios from the MLOps community. And I figured I'd just bring him along for another conversation. So Dimitrios, how you doing? I'm great, man. We're back. And I've got some bad news to break to you right now. I wanted to do it on air. Go for it. Just to get your reaction. Oh, boy. You can be vulnerable.
This is how we build community. Yeah, I'm nervous. Yeah, so PredictionGuard, awesome. Congratulations on all the success that you've had. We're doing a data engineering for ML and AI virtual conference. And one of your colleagues, Daniel, filled out the CFP. I haven't gotten back to him yet, but I can't accept him. I just am way too full, way over my head. And as much as I want to, I'm going to have to divert him to doing his own.
a special event. Basically, we're going to actually take what may have been a bad thing and turn it into a good thing. That sounds great. I'm looking forward to learning more. There we go. You know, I got it. I got to make sure that you get all the love and shine you deserve because I'm super stoked at what you're doing. Yeah, yeah. Well, appreciate that. It was great to see you. And you had your own event in SF. How was that? I do not recommend doing live events to even my greatest enemies. If anyone out there is contemplating organizing an AI conference, you can do it. But
I don't recommend it. It's painful, man. But it was a big success. It was just a lot of work leading up to it, as you can imagine. And we had fun on the day of. It was like, I think over 750 people showed up. A lot of great conversations. A lot of fun, spontaneous, sporadic meetings with people. And that's the stuff you get at in-person conferences that it's really hard to replicate virtually. You know what the secret is? The secret is it's AI and it needs a lot of hype. It really needs a lot of hype. There's one thing we don't have enough of in AI. It's we don't have enough hype. If you had hyped it more, it would have worked.
you know i do a fair amount of hyping and so for those out there that are sick of the hype like myself i've only got myself to blame on this Well, Chris, you sent me a very interesting looking hype filled chart the other day. You want to go into what that was? I will. And I'm actually blaming it all on Demetrius. He was making fun of the Gartner hype cycle. And gosh, I hope they're not a sponsor because we're making fun of them today. And he was going through that and it was funny. And I said, dude, we need to do an episode where we all analyze the Gartner hype cycle in 2024 for artificial intelligence. And we break it down and we're going to assess it and decide what we think of those things. And we're not doing this.
in our normal, extremely serious manner. We are doing this in the fun way. And lest you don't know Demetrius out there, which I can't imagine because he's a regular guest on the show here, he is, in addition to being a brilliant guy in this field, he's also the funniest man in all of artificial intelligence. So this is going to be good. And we're going to dive into the Gartner hype cycle today and break it down for you. We're going to start with the real one and then we're going to maybe make some adjustments to it. You know, Chris, you say making fun, but I mean, Gartner seems to have fulfilled.
mission. I mean, we're talking about the hype cycle. We're going into it. So maybe their mission was fulfilled and, you know, we are their fulfillment. Yeah. Oh my God. Yeah. We're hyping it up right now. Okay. And we're going to have fun doing it. I just have to say, yeah, please, if anyone knows how I can get a job doing this kind of stuff, just making up words and then putting them onto a wave graph, let me know because I would love this as a job. It just seems like it's too much fun. Well, let's see. I think surf's up. Let's hop on the wave and let's start talking our way through. You know, Demetrius, do you want to lead off on some of your ideas there?
So I think the most surprising to me out of this whole graph, and for anybody that's not familiar with the hype cycle, you've got the big upward side, and then it goes down, and it kind of crashes, and then it starts to climb back up. And it's the traditional- And the two-second version of that, and in a previous episode, I did a longer version when we were looking at some specific things on it. But the two-second version is new technology comes out. Everyone's super excited about it. They think it's going to be the greatest thing since sliced bread. It doesn't live up to the hype. They get frustrated. They go, this thing sucks.
And it falls down on the hype popularity side. And then cooler heads prevail. And they kind of go, OK, well, maybe you can do something OK. And then it's into a reasonable sense of productivity. So that's Gartner in a nutshell. So the biggest surprise for me is at the bottom of the slope. So after it's gone all the way up the hype cycle, it's come down and crashed down. And it is at the absolute bottom. The trush of disillusionment. Exactly. There is cloud AI services. Yes. And for me, that is the biggest misnomer. Because if anybody is making any money out of any of this, and I guess maybe hype and actual.
money they're detached and they're very decoupled here but for me that was like wait what there's no hype in cloud ai services so bedrock out of there hype is killed it's at the trough of disillusionment any type of sage maker if you're using that or vertex no out of there it's the lowest of the low and so when i saw that that was instantly like dude why are you even doing it yeah i did not believe a thing that i read afterwards but that was my thing any any big surprises from you guys i think you're Point on, if there's anyone making a killer amount of money on this, it's Microsoft, it's Amazon, it's Google. Part of my struggle here is some of these terms, like I could interpret them one way or another way, right? Like SageMaker, for example, which for those that don't know, it's kind of like a model deployment service within AWS and there's various convenience around it and that sort of thing. Like that's been around for quite a while now, like a very long time, even before sort of the kind of piped gen AI stuff. But yeah, so like, is that a...
cloud AI service, like that's been around for a huge amount of time? Or are we just talking about like hosted model APIs, right? They don't say. Which also, to be fair, have been around a long time. Like you look at something like OCR or translation or something like that. And cloud services have been around for a really long time and are.
sort of ubiquitously used. It's funny that it's down there. I get your point. Maybe it's just like everyone knows that's where the cloud, that's where all the services are. We're all paying for them. Yeah. So does hype correspond to usage, I guess? Like in this chart, is it that people aren't hyping cloud AI services, even if they're used? Or I think it's an emotional thing. You know, the hype side is, you know, how much people talk. So maybe it's accurate in this context. There is nothing sexy about AI services in cloud providers. And maybe that's what they're getting at is like, yes, we're paying an arm and a leg. We're giving them all of our money, but there's nothing sexy. But productivity wise, it's definitely.
productive. I would think so. Yeah, it's very pragmatic too, especially for those people just starting. I don't know any easier way than to just grab an API from like Amazon Bedrock is just the hosted model, hit that API like you would hit an OpenAI API, but now you have a suite of models, right? So that seems to me like a near miss. But then at the top of the peak is the other one that was a huge surprise to me because I've noticed this trend. I don't know if you guys have noticed it, but people who were formerly ML engineers.
we've all converted into being AI engineers. And an AI engineer is so misleading because you don't know, is that somebody that is coming from like a front end development world? And now they do a little prompt engineering. They use a few frameworks and they can chain together some prompts to make a bit of a demo on Twitter. And now they're an AI engineer. Or is it somebody that was deep, deep in the ML platform weeds? And because AI is now the new rage, they call themselves an AI engineer. So I don't know about that, but it's at the top. I think it's the same. I think people use AI.
ML and before it really fell out of vogue, deep learning interchangeably. Yeah, exactly. I don't know if it's also maybe connected to the fact like Chris and I talked about this, I believe it was maybe last week, the fact that some of the disillusionment around AI is sort of the realization that turns out AI is integrated in software and you still have to do engineering to like build software. And it doesn't just sort of like having a model is a solution doesn't really like play out in reality. You mean I can't just buy an AI model and stick it out there and magic things happen? Yeah, I mean, one would think... I'm so disillusioned. Yeah.
It's funny you guys mentioned that too, because I've seen a few people talking about how LLMs are not a product. You have to build on top of LLMs, your product or whatever it is, your service that needs to be there. So you can't look at an LLM as a product per se. And then I've also seen, or I've been thinking deeply about something that is like the companies that are really getting a ton of value out of this AI movement. I'm thinking about one of my friend's companies who does like a support software and now he's leveraging.
AI and LLMs for creating like multi-agents and helping answer feedback or answer questions and queries for support. And he's using AI. That's awesome. He's able to sell that support product to companies really well. What I haven't seen is companies that say, Hey, I am fraud detection as a service, and I'm going to sell you this, whatever traditional ML product as a service. Whereas you can create regular business unit.
products as a service that leverage AI, but you can't quite, or at least I haven't seen anybody crack the nut, create some kind of a traditional ML service type of product. I don't know if you guys have seen that. And I also don't know if I'm making much sense right now because it's something that's relatively fresh in my mind. I'm going to turn that one over to Daniel. No, I wasn't making much sense, I guess. I mean, so you've got like, what I would say is the things that I have seen most are either what you were talking about. So utilizing generative AI embedded in the functionality of sort of domain specific applications, like the customer service you're talking about or financial services or whatever, or access to models over some API infrastructure, right? There's...
maybe less like general, I guess maybe the biggest one I've seen is sort of just general, like fine tuning as a service. If you look at something like, you know, open pipe or something like that, but that's still fairly general purpose. It's not specific to any sort of use case that you might use maybe to some degree, you know, certain rag services would fit into that. Like we were talking to Pinecone about their recent, like they have more kind of prebuilt things to have you do kind of like load in all your documents and have rag set up and all that stuff. So I don't know, that's maybe the closest that I've seen to that sort of scenario. Yeah. Well,
Also, the big question is everybody wants to, and this kind of ties back into the hype cycle. Everybody wants to be doing rag and wants to have all these great use cases with their rag. And so like you were talking about with Pinecone, they make it really easy for you to do your rag. But then at the end of the day, is that a viable business or is that actually super useful? As opposed to somebody's got this support software that they can come in and really cut down the burden for your customer success engineers or your customer success people. And that is fascinating to me because it's a booming business right now. The rag business, maybe, yeah, that's great. Maybe there's some interest there. Is it a booming business? I don't know. I haven't seen numbers. But I think the really fascinating part to me is if you try to juxtapose that with like a fraud detection as a service type of.
product i just haven't seen that anywhere because i think a you're not able to really like give away everything as freely and be what works for one fraud detection use case doesn't necessarily it's not like you can productize that and then go out and sell it as a service in my opinion so so this is a little bit of a tangent i know but uh but that all that to say is we're at peak hype for ai engineers peak hype Yes. So I'm going to draw us back over to the hype cycle just for a moment. And I want to read, I'm going to do something boring for a moment. I'm going to read off the things where they are for our listeners because the three of us have the benefit, obviously, of seeing the graph in front of us and for listeners who aren't. So I'm going to take a moment and then we can go back and start hitting them there. Very quickly, heading up the curve initially, the innovation trigger. We have autonomic systems. We have quantum AI. We have first principles AI. We have embodied AI, multi-agent systems, AI simulation, causal AI, AI-ready data, decision intelligence, neurosymbolic AI, composite AI.
Artificial General Intelligence, otherwise known as AGI. And then we're hitting the peak of inflated expectations. At the top of that hype cycle, we have sovereign AI, AI trism, prompt engineering, responsible AI. And at the very peak... AI engineering. And then starting to slide down, we have edge AI, foundation models, synthetic data, model ops, and generative AI. And just going into the trough of disillusionment is neuromorphic computing, smart robots followed to the bottom by cloud AI services. And then we slide up the slope of enlightenment to autonomous vehicles, knowledge graphs, intelligent applications. And finally, the singular one on the plateau of productivity, which is where you want to end up, is computer vision, which is basically, yeah, we can do that. It's boring and no one talks about it anymore, but hey, we're making money. So if the listeners out there are
not confused. Oh, there's a whole bunch. I don't have any idea what they are. I was going to say, which ones do you actually know what they are? Because what the hell is embodied AI? Oh, I learned what that is after I put out the post. So someone said, oh yeah, embodied AI is when you use AI in robots. It is. So yeah, there's also a smart robots on the cycle. And I used it at a former employer. I was specifically doing AI systems in robots and I've never heard of it. You never called it embodied AI. Well, it's been a few years. I'll give you that. It was so, but no, we weren't calling it embodied. I mean, so I think I'm at like a 30% hit rate on.
these and i really would love to know what first principles ai is because that feels like buzzword bingo to the fullest i don't know um let's see first yeah daniel's going he's cheating he's going to models to find out he's um the car ai generated card in my google search says when applied to ai first principles ai suggests developing ai systems and algorithms by understanding the foundational principles of machine learning neural networks and data science from the ground up don't we do that anyway when we're isn't that kind of inherent in training new models and stuff Oh, but no, no, we're really going back. We're going back to the very first ones. You're at the second or third principle. Yeah, no, because all you guys that are out there that aren't using first principles, you know, that's lower down on the hype cycle. Okay. Yeah. So the other pieces, I mean, were there any other surprises for you guys? Because I have so many other pieces on here that I'm like, what? I think for me, like some of these things are themselves correlated and yet in different places on the chart, right? So it's like, if you look at generative AI foundation models, edge AI, AI engineering, prompt engineering,
probably some others on there, all of those like sort of fit into the same ish bucket and yet are on different sides of the hump. So yeah, I don't know, like some of these, it's also a matter of where do you draw the boundaries? Where's the boundary between generative AI and foundation models or generative AI and prompt engineering? I'll give you one, you know, as we're at the very bottom on the innovation trigger is quantum AI. And I've, okay, so that's not going to happen anytime soon. And I will note.
that they have it only greater than 10 years. But I would suggest it's probably greater than greater than 10 years. But isn't that, I mean, one of the things that's interesting about this whole cycle is there's that one, maybe you all can tell me or I can look it up. There's a one law, it's like a general law that people talk about where you underestimate short-term innovation and overestimate long-term innovation or something like that. Yeah, sorry, I said that backwards. Yeah, so it seems like it's hard to, especially the time angle of this.
It's hard to, because things just pop up and you like really didn't see certain things coming and others that you thought would come don't. So yeah, it's extremely difficult. 100%. One thing that I am just to tag on what you're talking about, Daniel, with the bucketing these, please tell me what the difference is between an AI engineer and a prompt engineer. Like a prompt engineer is someone that only does prompts, I guess. And that's all that matters. So they're just, so I can see how it's like, where's the line here?
When prompt engineering came out, Daniel, you might remember, I kind of made fun of that. I was like the whole that you talk about, like, because people were saying they're new jobs for prompt engineers and stuff. And I'm like, that is a passing fad. Like that will be just so ingrained in what everybody does all the time, that the notion of there being someone who that's at their entire job all the time for years is not going to happen. Yeah. I also didn't know. So like, I've never heard anyone use the word or if it's a word, it's an acronym, AI trism. Do people go around saying that? Yeah. What is that? What is it? So it's, I looked it up and you know what's, what's funny because.
This is exactly the area that I'm working in every day. It's AI Trism is tackling trust, risk, and security in AI models. Okay. You've never heard that. And I've never heard that, but now I feel like I should put it on our website because it's hyped. Yeah, you definitely need there. That's right. The funny part is it's almost as hyped as prompt engineering, which is basically all you hear about is prompt engineering, right? Yeah, they're right there together. AI Trism, you never hear about. Yeah, there you go. But the Trism, it's out there. It is.
We hear about the components that make that up all the time, but I've never heard them put together that way. And I'm sure there are people that are out there that their focus is in that area. And they're like, of course, it's Trism, honey. But guess what? Most of us don't know that. No, not at all. I don't even know. If I go and I just look at this, I don't know what causal AI is. I don't know what the AI simulation is. The multi-agent, I do understand. But then even when you say quantum AI, I don't know what that is. The one that I would say is probably in the wrong spot.
is synthetic data. It feels like that should be still going up on the hype train because we're just discovering what we can do with synthetic data. And every week, I feel like we unlock new use cases and synthetic data is just, it's the gift that keeps on giving in my eyes. I think that's the difference in you who actually does it. And somebody at Gardner, you know, who was tasked to go put the chart together and doesn't actually do the thing in real life. I've terribly offended somebody out there. Well, we're glad that it's out there. Let's just say that we are very happy that this exists so we can have a whole episode dedicated to breaking it down. Yes. It's a conversation starter. That's what I mean. Like achievement made unlocked. So one thing that I noticed isn't there at all, which really surprises me given how much it's bantered about is ethical AI. It's not on the chart. And that doesn't go in the trism.
maybe it does maybe this is where i you know is ethical ai now transformed from a labeling standpoint into trism is that is that where we're going i don't know or what is the overlap between responsible ai trism and ethical ai okay well yeah and there isn't really anything on here about gpus or hardware so yeah i think that's because they made their own hype cycle for gpus that's right if i'm not mistaken i feel like i've seen that somewhere on the internet you'd be cannibalizing your other chart exactly so you can't put any gpu hardware anything on the ai one you got to refer people to the gpu hype cycle and maybe it's like that with ethical ai like they made a whole other ethical ai chart that is the hype cycle for ethical ai maybe so i'm not familiar with it how many charts can you make that's if you're gardener i think they have i mean we have just the artificial intelligence hype cycle here but they probably have i think i've seen multiple you know subdivisions and stuff out there so that's why it's a great business to be in gardener selling all these different hype cycles
Well, speaking of what to hype, what, uh, what's not on the hype cycle, but should be. All right. If I could have talked to somebody at Gartner before they were making this, I would have advised. And so this is my, basically this is my video job interview right now. I'm busy typing an invoice up for you. Okay. Exactly. I would have advised AI gateway. That is very popular. That's climbing the hype cycle right now because people really like to have the option to hit an AI gateway. And if it is not that complex of a query.
You don't need to hit GPT-4. You don't need the most expensive model. If you have some kind of open source model that is cheap, then let the simple query go to that 7B model. And so I've been hearing people call it an AI gateway. Others, I think, have called it like a LLM proxy, maybe, or a router. Yeah, that's another one. So we would have to agree on the actual name, but that's gaining hype for sure. Yeah, agreed. Yeah, I've definitely seen the router language. Whatever it is, the languages overlap with networking, which is basically...
Like you're just routing API calls. So I guess that makes sense. Yeah. Any that you guys would have liked to have seen on here and where? I had the ethical. I'm still wondering what composite AI is. Did we ever get that answer? Or am I having a senior moment or something? What is it? Yeah, what is it? The one that really stands out to me, unless I'm just like, there's a lot of words on this page, so maybe I'm totally missing it somewhere. But where is multimodal AI? Oh, good catch there. It's not on here, is it?
No. Who cares about multimodal? That's so weird. That should be in the peak of inflated expectations. This is like the thing of 2024, like multimodal AI. That's so fun. Even multimodal rack should be on here, like climbing the innovation trigger. Multimodal models should be on the peak of inflated expectations. That is such a good catch. I know tons of people who say multimodal and have no idea what it means. Well, what does it mean, Chris? Quiz time. Well, it's having different modalities.
of input there so that you can combine different inputs to get a rich output, you know, in a very general sense. I have no idea. Yeah, so voice, photos, yeah, video. Voice, photos, video. Yeah, all the things. All the things, yeah, exactly. Which is what we want. I want to throw a bunch of stuff that I have and have a fantastic, just have it sorted out and give me the best answer. And even with today's multimodal models, that doesn't happen very well. I'm often frustrated and disappointed with those outputs. So yeah, I'm expecting better. Yeah, and along those lines, I have to...
that i would like to have seen one is just transformers in general where's that where are they on this hype cycle because that also feels like Are they climbing or are they going down? I don't know. It would be a trough of disillusionment heading downward because we're past that. And people are now talking about post-transformer models quite often. So it's kind of like, yeah, yesterday. So there needs to be another dot for post-transformer models. That's definitely going up. That's right. Speaking of which, it feels like, okay, we've got small language models. Where are they? Because that is all the rage. It is. That was like, and maybe it's all the rage for every vendor who is not open AI.
because they can't compete on GPT-4. And so what do they do? They say, well, you can just host your own small language model and fine tune it and get better performance than GPT-4. And so I think small language models are probably, they should be in that innovation trigger, maybe the peak of inflated expectations because anyone who's ever used the 7B model. might not want to use it if they have the choice well maybe maybe it's is it are you sure that's going up or could it possibly be sliding into that disillusionment that you just revert to potentially that's because maybe it is going into the trough of disillusionment uh you know just hypothetically because i do think that when it gets to the plateau of productivity small models will be this just the workhorse you know you'll have them out on the edge everywhere every freaking device you've ever imagined or seen is going to have small models in it that are inferencing we won't ever have anything that doesn't have them it'll be just the Oh, yeah. And of course, we have our small models in our watch, which leads me to the next one that I'm like, where is this? Why do they not have wearable AI? That is a perfect buzzword that should be on here. And if you look at like what Meta is doing with the glasses or if you see any of those necklaces that you can wear and it records everything. Yeah, that's wearable AI right there. I just I may have just made that up or I may have seen that before, but that one should be on here. It should be there. I agree.
Hey friends, OutShift, Cisco's incubation engine, merges innovation with the art of possible, a launchpad for transformative emerging tech. OutShift blends startup agility with corporate strength to develop next-gen technologies from the ground up in AI, quantum technologies, cloud native, and more. Their newest AI innovation, Motific, addresses a critical challenge in the rapidly advancing world of Gen AI. Bridging the gap between concept and deployment, this model and vendor agnostic solution supports the entire Gen AI journey. From assessment and experimentation, Motific accelerates deployment from months to days while safeguarding against Gen AI security.
trust, compliance, and cost risks, all while empowering business function and IT teams to rapidly configure end-user assistance powered by organizational data. Motific provides advanced, customizable policy controls to prevent unauthorized access to sensitive data and helps ensure compliance throughout the entire process. With deep visibility into operational and business metrics, Motific enables you to track ROI, optimize costs, and make informed decisions. By offering a centralized view, Motific deters shadow AI usage and empowers teams to innovate responsibly. So move beyond the traditional constraints of AI implementation, utilizing AI deployment that is both responsible and is revolutionary, ensuring your projects are not just quickly launched, but built on a foundation of trust and efficiency. Visit motific.ai. That is M-O-T-I-F-I-C dot A-I. Maybe this fits into kind of the agentic stuff that is represented in certain ways on there, but this whole idea of whatever, you know, like.
tool function calling slash like text to SQL, like interacting with structured databases, APIs, whatever that is. I don't know, like maybe the general name for that other than tool and function calling or text to SQL, but certainly that's like sliding into a zone where people are definitely doing some of those things in production and there's products released around it. So like the hex magic stuff and all that other. Where is it on the chart though, before we go on? Oh, where is it on the chart?
i mean it's got to be somewhere somewhere around ai engineering so to the peak of uh maybe maybe yeah i don't know i don't know it might be maybe it's going down because people are like uh agents aren't reliable i think that's right i think it's heading down into the problem disillusionment that's where i would guess yeah yep and if you compare that to where they have it multi-agent systems it's got a long way to go up it is at the very bottom of this cycle so yeah i think we instinctively are like, no, please, no more agents. Gardner's like, oh, we're just getting started, baby. Well, and they're like, no, please, more agents together. Multi-agents. Gardner's going to create their own agent hype cycle next. That's going to be the next one that they can create. And so we'll, you know, take a commission for giving you that idea, Gardner. No problem there. One thing, can we call out the elephant in the room? Because where is retrieval augmented generation on? How is that not on here? Really? Rag? What's that? Because I was thinking about it.
I was thinking about it and I was like, oh, you know what they missed is graph rag. That is all the hype these days. And that's probably right around where sovereign AI is, where it's maybe like the border. Yeah, it's going up nearing the peak of inflated expectations. You're right. More hype than the trism. Yeah, more hype than the trism. I would argue rag is hitting to the trough of disillusionment. Anyone want to disagree with that? No, no, I think so, too. I think it's over the hump. I do, too. I mean, it's and people are kind of hitting the challenges and, you know, and actually.
Daniel, advanced rag, you know, which we've talked about several times, you know, kind of, kind of trailer. Well, we don't just have rag now. We have advanced rag. And as things are starting to head over that peak of inflated expectations with rag, well, guess what? We can do some more. We have advanced rag. But I think, I think the whole thing is starting to go over the side. You know, people are like, okay, well, we've kind of done at least the easy stuff to the advanced rag point. There are people that are, that are doing it better than others, but nonetheless, you know,
It's, you know, what's next? So I'm just curious, two second deviation. We've talked about, you know, fine tuning. We've talked about RAG. What's coming next in that sphere? What are they missing there? Yeah, a new model. Yeah, I think you mentioned that you might have had some of these, Demetrios. What are AI hyped items that are your own, that you've come up with a name for that other people will have to interpret?
to figure out their definition. You want to guess on this one? All right, here we go. I am going to start you off with a pretty simple one. This one is free range AI.
Free range. Is that open access LLMs? Close. Close. What do you got, Chris? Grain fed. I can't get off the free range thing. I'm an animal guy. I can't even get into the AI headspace on this one. That's AI that was trained without guardrails. Okay. I like that. Well, we already talked about one here that you alluded to, Demetrios, but my name for it was Trinket AI.
Wearables? Yes. Yeah. Yes. Trinket AI. Yeah. Imagine it's in your fidget spinner. That sounds a lot. Right. That's a much better name than wearable AI. Yeah. Trinket AI. It is. Every little thing you have on your body has a freaking model inferencing on it, you know. And it doesn't bring you any extra value if we're going to follow the AI trend. You just want to think anymore. You can click that button and take a picture, Demetrius. No, it just gives you some verbose answer to a question that you didn't really ask.
So your shirt, you're like, hey, have I been sweating? And then it tells you the origin of sweat in a three-page PDF that you have to go download. Do I get senior moment AI? That would be good for me. There's a huge market for that. Everybody over the age of 50 is going to buy senior moment AI. Oh, there we go. And I can continue instead of pausing for the next three minutes to try to figure out what it was I was about to do. Or I was thinking that that's how seniors interface with AI so they don't get left behind. It's like, this is the product that will make sure.
you stay up to date you're ahead of the curve okay sounds good all right i got another one for you all this one is EQ AI. Oh, empathetic AI. Yeah. So it's also been known as empathetic AI. Yeah. You may hear other people out there and on the streets calling it empathetic AI. This one is a type of AI that has high emotional intelligence and it feels empathy for you when you get frustrated that it's not giving you the right answer and your prompts aren't working, but it doesn't actually make your prompts work. It just feels bad for you. Okay. I, that minus the AI bit that happened to me yesterday. I was on Comcast on their stupid tech support for four hours texting.
They passed me off and everyone was so empathetic, but they accomplished nothing. If you put that in AI, I'm quitting AI. If you put that into any AI that does that, I'm just done. I'm walking away from the whole field. Are you sure it wasn't already AI that you were talking about? It could have been. I mean, it was just text. It was only text, but it was horrible. We've already passed the Turing test. I'm getting responsive. I'm so sorry. I'm just very sorry. We're here to help you. And I'm like, I'm going to freaking kill you. That's what four hours texting support will do.
If you bring that to AI, it'll ruin the whole thing for me. Well, this one, funny enough, is actually on the uptick. When you look at the slope, the EQAI has got a lot of runway left. Yep. So my next one is either AI nepotism or AI anti-nepotism. Oh. I don't know. I'm trying to make that. Fighting AI nepotism. Fighting AI nepotism. Oh. You're going to have to go into that one for me. I've stopped you. Yeah, yeah. This is exciting. It's basically...
using ai against like the government using ai or what no no so uh foundation model related maybe yeah so this would be like multi-model ai in that you are not preferential to one language model family and only using that family but you are now multi-model and you know as such not practicing nepotism but are you multi-modal multi-model this is also maybe not you know i knew it by its other name uh which is polygamy ai Yes. Oh, gosh. Where am I going? Or some in San Francisco call it polyamorous AI, as it tends to be. So the next one that I've got for you. Oh, where is this nepotism AI on the hype cycle, by the way? I think it's still a bit on the rise. I saw A16Z in their post. One of the things they called out was multi-model future. Oh, yeah. There's a future for this one. That is for sure. So I've got one that is called broccoli AI. Okay.
This one's going down. Is it related to some sort of graph thing? No, but that could be nice. Is it synonymous with healthy AI? Yeah, exactly. Maybe you've heard it termed healthy AI. Efficient.
Yeah, it's sustainable. No, so, oh, that's another one that I've got though, but we'll get to that in a minute, which reminds me, like it does feel like sustainable AI should have been on the real hype cycle. Like that's an actual term, isn't it? Yes, it is. And it's not. And it's not on there. The other one that should have been on there that I was like, why isn't it on there is Ensemble AI that feels like, or Ensemble models. That feels like it should have been on there. See, one of the ones that I looked up was Composite AI. Yeah, that's the one I didn't know. I think, well, I don't know. It's slightly different than Ensemble, but I think that they, like Composite was combining multiple.
multiple ais together um in some way or another for one inference like you have multiple you know models inferencing but you have one inference back out to the user yeah something like that i don't know although ensemble could very yeah very much mean for a single inference getting a majority vote or something like that okay so it would be where composite ai is on the chart if they're assuming they're correct yeah and we're before we leave it sustainable ai where is it on the chart that's very much like it's got a lot of hype to go yeah i think it's low to mid-level mid-level on the on the curve up Just think about how many people are talking about the energy that is wasted training foundational models and how we need to build out all these data centers and they need to be sustainable, et cetera, et cetera. So yeah, sustainable AI for sure has some room to grow. Back to broccoli AI, AKA healthy AI. This is AI, and this is very much on the downslope again. It has passed its peak. People are a little disillusioned with it because it's AI that doesn't taste good for the organization, but it's needed. And so you can imagine the cybersecurity folks.
they love this kind of AI. Is this like a linear regression model or what would you consider good for an organization? I think you use the word good. Yeah, healthy. It's healthy for the, we could go to healthy for the organization. What could that be? I mean, I actually didn't get to do enough market research in this section to figure that part out. You know, I was just throwing spaghetti at the wall. But if I were to think about what's healthy, yeah, it would probably be the traditional ML. Going back to the, what I was talking about before, like fraud detection is one of those where it's not really AI. Some people might know it as its former term.
ml so i'm telling you they're all the same from a marketing standpoint exactly well yeah the waters are too muddied for them to make any actual difference that's right so what else you got what else you got okay so i've got unsustainable ai which is way different than sustainable ai just so we're clear but it's not even it's a whole different uh sector of the universe that we're talking about it's not like oh it's just the opposite of sustainable ai unsustainable ai is it's got It's at peak hype right now. Let's be honest. If I could swap it out with AI engineer, it is at peak hype because this is AI that was built for a product demo, but not for scale.
That is unsustainable AI. Happens all the time. Yeah. So anything that you see, basically, we can hopefully know these guys are your sponsors, but let's just cue Devin or Rabbit or Humane, all those unsustainable AI. The trinkets? The trinkets. Yeah, that's true. So it's sort of analogous to doing like prototyping software where you're never intending to grow it into production. Exactly. So that's all of mine that I could think of. Well, I think that was a pretty good list. I did realize, I don't know, maybe related to some of the discussion we had earlier, but.
I don't see neighborly AI on here. That's kind of creepy when you think about it. I wasn't creeped out until you said that, but. I had this image of Mr. Rogers' neighborhood, you know, instead of Mr. Rogers, it's the AI. Hi, girls and boys. Maybe they can help you clean up a few things with their rags. No.
Oh boy. Well, I was thinking it was like next door where it was almost like the voting system, the ensemble, but it was for local LLMs. Gotcha. Yeah. I realized there's nothing about vectors or embeddings on the chart. I was just thinking about that. Actually, there's, yeah, there's no vector stores on here. Or even just general embeddings. Embedding models. Yeah. Wouldn't that be plateau productivity now that we've had this for so long that they're just, I don't know, lexicon, no emotion left in them. Yeah. What I was thinking is they probably aren't on there because Gardner also has one of their.
best products ever, the Magic Quadrant. And that'll be the next episode that I come and drop in on. We can remake the Magic Quadrant for the different sectors. And I imagine that they have a Magic Quadrant for vector databases. Yes, that sounds delightful. Yeah, well, it has been delightful to have you on, Demetrius. I'm glad you brought your various new AI terms to the hype cycle. And now I have some work to do on my broccoli AI. Incorporate that into your product for sure. It's right around there, Trism.
It would be a good AI logo, just like a broccoli florette. Yeah, the broccoli. I saw a great paper that was all about leaks. It was all about data leakage when you send API calls to OpenAI. And the paper started with an emoji of a leak. That's awesome. Like the leaks you eat. And it was basically showing how you send your data to OpenAI.
A lot of other people are going to get it too if you're not careful. Yeah. Which is one thing that we haven't really touched on, but that seems like it's got some hype around it. It's what? Data leakage, AI. Data leakage, data poisoning. Data poisoning. I know in my day job, that's a common conversation. Yeah. Prompt injection should be there. Prompt injection, yes. This all fits under Trism. Yeah. This is it. We're going over Trisms right now. Trisms and trinkets.
On that note, that very profound note, it has been great to discuss all the trisms with you, Dimitrios. I've had a blast, as always. Please come back. As usual, give your own hype about the upcoming event before we close out and where people can find out more about it. Yeah, I always feel bad. I come on here and just show my stuff. So this time, no shilling. I've just had a blast doing this with you guys. So if anybody wants to find out about the next virtual conference or the in-person conference, they can just Google MLOps community and I'm sure it'll pop up. Cool. All right. Hey, much appreciated. We'll talk to you soon, Dimitrios. Thanks, man. Thanks, guys.
All right, that is Practical AI for this week. Subscribe now. If you haven't already, head to practicalai.fm for all the ways. And join our free Slack team where you can hang out with Daniel, Chris, and the entire changelog community. Sign up today at practicalai.fm slash community. Thanks again to our partners at fly.io, to our beat freaking residents, Breakmaster Cylinder, and to you for listening. We appreciate you spending time with us. That's all for now. We'll talk to you again next time.