Skip to content
MLOps at JFrog with Bill Manning episode artwork

Dec 17, 2024 50 min

MLOps at JFrog with Bill Manning

from Software Engineering Daily Hosted by softwareengineeringdaily.com

JFrog is a DevOps platform that specializes in managing software packages and automating software delivery. One of its best known services is the JFrog Artifactory which is a universal artifact repository. JFrog is also focused on rapidly emerging needs in the MLOps space. Bill Manning is a Senior Solution Architect at JFrog. He joins the podcast to talk about his background in startups and venture capital, and his current work in ML at JFrog. Sean's been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn. Please click here to see the transcript of this episode. Sponsorship inquiries: [email protected]

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

MLOps at JFrog with Bill Manning

0:00 50:29
of matches

Transcript Auto-generated, may contain errors

JFrog is a DevOps platform that specializes in managing software packages and automating software delivery. One of its best-known services is the JFrog Artifactory, which is a universal artifact repository. JFrog is also focused on rapidly emerging needs in the ML ops space. Bill Manning is a senior solution architect at JFrog. He joins the podcast to talk about his background in startups and venture capital, and his current work in ML at JFrog. This episode is hosted by Sean Falconer. Check the show notes for more information on Sean's work and where to find him.

Bill, welcome to the show. Well, thank you so much for having me, Sean. I'm really looking forward to this today. Yeah, absolutely. Thanks for being here. So I'm excited to talk more about JFrog and DevSecOps and some of your areas of expertise. But first of all, I wanted to guide in a little bit of your background. Who are you? What do you do? Explain your role at JFrog.

Yeah, absolutely. So I've been with JFrog coming into almost eight years now. Prior to JFrog, I've been doing this for a long time, started my career around 97. Yes, I'm not old and that's what I do, but I've had a very successful run. I've had three acquisitions. One of the things I've done since I began my career was always pick different technologies every time. First company I had was a first web-based CRM platform. A lot of the people that were there went on to form things like Marketo and SugarCRM and Salesforce. Next company I did was email encryption and security and we sold that to Cisco in 2006. Third company was IoT before IoT was even a thing. It was called Forehome. It was a connected device company. We sold that to Motorola and Google in 2010. I was a venture capitalist for a bit. I was with Vodafone Ventures. I was senior.

media partner. Then another company called XTV about media consumption, took that public in Australia. There's some other work around after that with some startups. I'm also a mentor. And then I joined JFrog a little over eight years ago when they were, you know, midway into the company and I sprints here. And they said, we'd love for you to come in and give your input. And since then I've been a solution engineer, solution architect, managed teams here. I do everything from a little bit of marketing to sales, to you name it. Currently right now I'm transitioning over actually into machine learning. And so our JFrog ML platform, which we just launched this year with the acquisition of Quack, I have now joined that team on a go-to-market strategy. And on top of that, also to education and things around that.

So that's me. That's awesome. Yeah. I mean, it sounds like you have a whole breadth of experience. You can kind of be the ultimate gap though, or regardless of, you know, what the problem area is, you can, you know, jump in there and add something to it. Jack of all trades in a way. Like I learned in my startup years, you know, how to do everything from legal to marketing, you name it, because I had to, no choice when I had to do it. Yeah. I mean, I had a similar, you know, I founded a company and, you know, I was the CTO.

But that company had mostly experience in engineering before that. And really the way I got my business degree and my marketing diploma was because there was no else to do those things and you're just like forced to do it. And I think it's taken me on a career path I probably never would have done if I hadn't been a founder as part of that experience. You got the practical MBA, as I call it, right? You got the hands-on MBA. The things that they teach in the MBA school, you learn the hard way. I made a lot of stupid mistakes. Oh yeah. I'll be the first to admit it too. And I'll be like, oh, that was dumb. Yeah. So you had quite the run career in terms of picking the right kind of companies to be part of or companies that have had successful access. What is your strategy there? How have you been?

able to pick these companies. I'm a very weird being in a lot of ways. A lot of friends say that about me. People have known me in the industry. One guy from a certain venture capital firm, I won't say who he is, but he calls me his lucky rabbit foot. I seem to be able to sniff out technologies in advance. And sometimes actually I've had some of the technologies that I've worked with or, you know, with companies we've started or things I've done, or we might have been slightly ahead of the curve. I have a tendency to be able to sniff things out and I don't know what it is. There's no real strategy as a feeling more than anything. And it also stems from just my inherent, you know, the reason why I got into this industry in the first place is the evolution, the change. It's not stagnant. It's always flowing. And that was a huge kick for me was like, do I want to be in like, here I am 52 now, but like when I was in my early twenties, I was like, do I

want to be the person that's doing the same job and gets a pension at the end of 50 years? Or do I want to be on the bleeding edge of stuff all the time and always be learning? The thing is, I like the fact that I'm in an industry where I have to constantly keep my skills honed. I constantly have to be learning what's out there. If you don't do that, you're not going to survive, especially in this industry. I mean, like I said, at my age, we're in an industry of ageism. And the thing is, and I hate to say it that way, but it's true. But that's the thing is, the way I have to stay relevant is by staying relevant, staying up with the trends, learning the details, not honing on skills that I learned a long time ago as being bedrock and solid, but always evolving and changing.

Yeah, I've certainly worked with people, especially on the engineering side in the past. They had sort of their toolkit. And they don't necessarily want to expand that toolkit. You know, they want to go and they apply that toolkit and they can do it very effectively, but that's, you know, kind of what works for them. I think I'm more also aligned with you where I've always been driven by sort of the educating and pushing myself to figure out, I want to work on the edge of technology essentially. And that's why I spent a lot of time too long in school to educate myself and really work on the edge of technology. Come on, let's think about it, right? I mean, you know this, you know, the thing is, is when you read about something, you start learning something and then you start applying the practical portions of it and you get that first light. We used to always say in our first thing, I'm like, what's the first light where you get the product to be? Whereas that first moment where you all can sit around and look at each other and say,

damn, we did it. You know what I mean? Like, this is the start. We know this is something. And I still love that. Like I said, right now, I'm working on a couple of things, you know, outside of JFrog to kind of keep my skills up. And when every time I have one of those little epiphanies, and actually one of the companies that I've had was Epiphany, but one of the epiphanies is like, when you get to that moment, you go, okay, yeah, you know what? This is practical. I get it. What's next? And then in my head, whenever I've done this in the past, my floodgates open on what's, you know, possible. And also too, what are the restrictions? What are the constraints I'm within and how I break down those constraints and barriers? Yeah. So what's kept you at JFrog for eight years now?

Number one, the people. I'm going to be honest. I love the technology. I love the platform. I get to work with some of the biggest tech companies in the world. That's one part of it. The thing is, is I love the people I work with. You know, like every other company, you have to be in a, you know, be able to work with these people you're around, right? You need to be able to get along. And we have very interesting hiring policies here. You know, are you a frog or non-frog, right? I thought in the beginning, I was like, oh, that's cute. You know what I mean? But now I've learned over time that that's actually a real thing. We have quality on who we bring into the company. And the thing is, is that, you know, I'll tell you, some of the hardest situations we've had here, I've had some of the most delightful and fun discussions because, you know, in some cases, when things get tough, humor is the

train and be able to have people that are in the same similar mindset where you can have that is exceptional. And so for me, having people have the same mindset around me has been one of the major things that has kept me here. Secondly, like I said, I get to work with some of the largest companies in the world and always be on the edge of creating something that will do something. And the thing is too, is I always make the joke whenever I talk to say customers or prospective customers, especially if I'm a consumer of their products, I want to be able to say, Hey, you know what? I'm here to help you make yourself better, compliant, safer, because I'm your customer, right? I want to ensure that my own personal data, my own personal safety is a top notch. And this gives me a chance to have some sort of influence into that.

And so it's a lot of different things. And also, JFrog has afforded me the ability to be out there, right? The big joke is sometimes people say I'm one of the faces of JFrog. I do a lot of our public speaking and webinars and things like that. And I enjoy that. For a person who gets stage fright, I enjoy it. And the thing is, so there's a lot of different aspects. But like I said, it also encourages and nurtures employees here to take those steps and keep going. And I also love being able to mentor others, like I was mentored when I was younger, and bring my perspective. And there's a lot of people here that I think that I love having those conversations. I love the diversity. I love every little bit of it. And that's one of the things that keeps me here, to be honest. Actually, it's the longest I've ever been at a company. I've been one of those ones that's constantly evolving and going.

This company constantly evolves and goes. And so it falls in line with my mantra and it gives me the ability to also excel and exceed with the product. And like I said, work with large companies and work with companies that are making a difference. I always make the joke that people ask me, like, yeah, from Chick-fil-A to SpaceX, you know, like we have this whole large swath of things that we do and that's exciting. Yeah, that's awesome. You know, John Maxwell, I think said, you know, people quit people, not companies, I think is a quote. And it's true. Like, I think very few people are going to stay at a company.

that is up in the right if they hate their day-to-day and they can't stand their coworkers. It's just going to be a miserable, maybe some people are willing to do that, but it's going to be a miserable existence. And the great thing about working in technology, especially on the technical side, you have a lot of options. So you don't have to kind of put up with that stuff if you don't want to. And I can tell you seem very passionate about this. I can understand why they have you out there as the face of the company from time to time. Where was JFrog in terms of their size and development eight years ago when you joined versus where it is today?

Oh, absolutely. So when I joined the company years ago, I mean, I was employee about number 123. And now we're up to almost 2000 employees. You know, we were like 35 million in revenue that year when we announced it. And, you know, and since then, you know, you can see where we're at now, you know, heading towards massive revenue and scale. When I joined, we were, you know, just shy of, I think about 2000 customers utilizing our platform, which was exciting. And now we're almost at 8000. You know, the thing is, is that over time watching this grow and expand and have different locations around the world. It's fun to be in the roller coaster as it's going. And in this case, the roller coaster.

Doesn't have an end. It keeps going. But, you know, it's a thrills and chills and ups and downs. But the thing is, though, is that you're there constantly and watching JFrog grow and being there in the front seat, you know, with some amazing people that have gone along for the ride with you and having that shared trench story. You know, you're in the trenches together. You know, times are tough. Times are good. You know, for me.

It's been exciting watching the growth. And the thing is, we've adapted and we've always been kind of at the bleeding edge of what's next in terms of that. And so we're able to meet the market where it meets. You know, in some cases, we might be a little ahead of the curve, but we're laying the groundwork, right? And that's the thing is, is that like now, like even for me, jumping into, you know, this whole idea of JFrog ML and ML Ops, and it's exciting. You know, every company is going to have AI eventually integrated at some point or some sort of machine learning into their application. It's already starting. It's been starting for a while, but be able to actually have an, I look at where that is compared to like DevOps was years ago, where it's this massive playing field of all different technologies. And with JFrog, one of the things that also attracted me.

was universality that we've actually embedded into our messaging, which is like, I always equate it to, we're the most perfect conveyor belt, right? Raw materials on one side, that's the raw code, the third party transit dependencies and that, and some sort of manufactured product at the far end. And we're in between there, we provide that layer of consistency. And the thing is, you have all these different tool sets. And the thing is, is I always had this map that I always show, like, here's the terrifying realm of DevOps, right? Every single tool in every single category from ERP to like CICD to security. And then platform engineering came in, right? It was like, okay, let's start wrangling this down into some sort of consolidated platform. And it's the same thing going on right now with ML, right? You look at all the different tool sets.

all the different things for tuning and rag and all these things. And we're trying to address that same level of market. So for me, watching the company evolve and say, hey, you know what? We want to be that layer. We want to be that base foundation, the pillar of technology that you build your software on. And whatever you choose, because every software company is different, that's exciting too, by the way, is the fact that this company has evolved with that and preached about the idea of we're going to help make it more efficient, more effective, more secure. We're going to be able to deliver your software better. You're going to be able to go ahead and update those devices in the IoT realm. Now we're saying, okay, you know what? We're going to bring compliance. We're going to bring speed and accuracy and efficiency now to ML and MLOps. Because the thing is...

based on hardbacks, 85% of ML technologies out there that are developing, 85% of those never make it to production, right? As you're doing this. And how do you increase the fact that that should be lower, right? It should be half that or even less than that. And you should be able to say, let's build something, let's evolve it. And like I said, for me, JFrog has been an extension of that, of that natural trend of the actual industry and our ability to be that consistent base layer that allows them to do what they need to do as a company and ensure that they have a consistent set of tools, accuracy, and efficiency. And I'm fortunate enough to work with people that want to provide that to them.

Yeah. I think, you know, to your point, there's so much new tooling essentially going on in the ML space right now. I was looking at even just with agents, like the agent market landscape chart the other day, I think it was maybe from Menlo Ventures or one of the VC firms. There was easily 200 logos on this thing. And agents is like the new, new thing in general. If you expand that to the entire plethora of stack, it's like thousands. I work in the space and it's hard for me to even stay on top of it, let alone somebody who's just like thinking about, oh, like maybe we should kick off, you know, an AI project, like, you know, where to even begin. And even now, right? Even those are starting to segment, right? So even those layers of that landscape are starting to segment.

And that's the thing is, is that initially when people like have this mess, there's always a way, right? There's always this massive umbrella of what something is. And then inside of that umbrella, then things start to segment and factions start to come about. And like I said, Asians, in my opinion, is the new battlefield. When you look at it, right? Everybody's vying for the perfect thing. And the thing is, is that when you look at it, it's like you said, it's now.

Whenever technology, this is the way I always look at it, right, is that when there's a segment of technology that gets more involved, people see that this is actually a value add. They want to get into this space. Ideas start happening. It's not a bad thing, right? I mean, this happened with the dot-com bubble, right? It was like, you know, initial thing that happened where people were like, hey, you know what? This is new. This is exciting. Retail, commerce, education, information. And then it got into these segmented markets of little bit players all over the place. Then it went to the next part, like mobile, same thing, all this. Now, ML is the same way. It's like, here started off with a small consolidation of things, but then people go, I got an idea.

And then the ideas start to spread. And then you're going to start to see is that 200 logos probably shrink down to 15 or 20 logos. And then eventually work its way down to like five or six major players, right? So basically it's going to shake out. There'll be mergers, acquisitions, people will drop off. You know, some tools will come across as strong, but they're inferior. You know what I mean? There's that natural shakeoff. And that's what the other part, like I said, one of the other things I love about this industry is that if you want to look at natural selection and natural ability of like, you know, our industry is a living industry. And I love that. The fact that it does change, it does evolve. You don't really see that with CPA work.

Yeah. And I think, you know, I've been in industry long enough and you have as well, where we've seen multiple cycles of these. Essentially, whenever there's a new sort of shift, there is like this massive expansion, essentially, of players. Even you go back to social and people who are around for this might not remember it, but like there was. endless, you know, essentially takes on social networks. You know, Facebook overtook MySpace and sort of, you know, leading the charge there, but there was a lot of competitive players that had their own, you know, takes on that. And now we've really like consolidated the market to, you know, a handful of players. I was like, do you remember Friendster? Friendster couldn't scale basically. Their MySQL database fell over and they didn't have the tech talent to scale it and they basically died. Right. And that's the thing is actually, if you look back at it, I was talking to a friend about this recently. It's so funny you brought this kind of stuff up because like, I was talking to a friend about this recently and we said, actually, if you look at the design and everything that was around Friendster, it was actually a superior platform in terms of usability and design. But...

Like you said, the back end of it couldn't support the heavy weight in which they enacted, right? They had a bunch of brilliant front end, a bunch of brilliant UX and UI and interoperability people. But on the other side of it, they couldn't compete. And the thing is, by the way, remember that was early. There was no real cloud scale. There was no real Kubernetes. There was no way to provide an infrastructure without physical servers. I mean, I make the joke of like trying to explain to younger engineers. I'm like, you don't understand. I had this one startup where we needed servers. And I literally went to some really sketchy location in Fremont to some warehouse where some guy sold me 10 servers. And I had to scrape the DOJ stickers off the servers and wipe them out and bring them back to my server location because that's all we could have.

board. And now it's like, I go in and be like, I can just auto scale anything I want. I mean, it's amazing once, you know, I've always been a big fan of adoption of things like cloud native and all that. And like I said, one of the things I really enjoyed about coming here at JFrog was, you know, we're governance board members of the cloud foundation, helping to find that roadmap for all these companies that have that successful scale, not to fall into the friendster trap of, you know, tipping over at that, you know, 1 million and one user, right? You know, plus one that just killed it all. But on the other side of the two is, you know, to work with a guy like this guy, his name is Remus. Remus is one of the co-creators of Helm. He works here.

Amazing, right? It's like royalty, in my opinion. Other people are like, oh, that's cool. I'm like, that's super cool. I got to see the guy who's like, what was your inception? What were you thinking when this was coming about? How did this orchestration? I had so many questions. I was like a fanboy. That's awesome. I mean, I think that's one of the great things about working for some of these larger tech companies in the Bay Area. It doesn't have to be in the Bay Area, but you do send a run into some of these people who've invented technology that's widely adopted as an industry standard, and they're just there as an employee, and you can talk to them and pick their brain. So I want to transition a little bit to get into some stuff on DevSecOps.

Just to start, for those that are maybe less familiar with the space, how do you define DevSecOps and where does it kind of fit into a modern software lifecycle? Oh, absolutely. It's essential, in my opinion, right? The thing is, if you're not adopting this ability of constant, you know, here's the thing is, you know, we've always talked about, whenever I discuss DevSecOps, and I give a lot of talks on this, you know, over time, I always start off with just the speed of builds, right? Like when I started in the industry, we did quarterly builds, you know, we did quarterly releases. I mean, you know, we did builds and we did testing, but we only released our software, you know, once a quarter, you know, and it was a big announcement. Hey, we spent, you know, 90 days working on this piece, you know, this upgrade to what we're doing. And yeah, you know what, we build it occasionally, you know, we test it and things like that. And then of course, you know, everything started to progress, you know, builds up, cycles got faster as automation became more available. And then of course,

you know, in 2006, we started getting into the whole idea of DevOps, right? You build it, you run it. And, you know, tools like Docker and orchestration and all that, you know, once again, it was a Wild West show. You know, you look at all the tools that are out there to do something. But the thing was, is that there was this essential idea of DevSecOps, you know, being able to have faster release cycles, being able to have security enabled into it, right? Originally, it was just DevOps. You know, the security came and said, you know what, we should really...

do something to make sure that things are safe, secure, and compliant. And the thing is, is that having these iterative cycles, having the ability to create things that allow you to build more rapidly, deploy more rapidly, is essential, right? I don't see organizations living without it. It's funny, as in some cases, you'll see technology, well, not technology, but more like trends like DevOps or others, ebb and flow and change or disappear and they evolve into the next thing. Look at Agile, right? Agile came about, now people are like, it's Agile dead, you know? It's all these things, but DevOps and DevSecOps is essential for speed, accuracy, and go-to-market. And having the security behind it ensures your ability to perform for your customers, non-dependent of siloed industry that you're in.

But by providing not only the best software, but the most secure and compliant software, which is, you know, we know, as you know, this, you look at the trends and the numbers, you know, like the number of increased in supply chain attacks that are happening that compromise people's software. We always go back to SolarWinds. It's still, you know, it's a use case that'll be studied for decades, right? You know, and that was a fourth level transit dependency in the cycle. You know, I mean, it was deep, deep, deep into the recesses of this actual application. And it caused $100 billion worth of, you know, whatever problems around the world. But the thing is, is that companies that need to adopt this because it allows them to automate more, do more, make sure the things that they're doing are correct and they're compliant and safe and secure.

ensuring the stability, ensuring security, ensuring resiliency. All the words that you hear when people talk about DevSecOps are true. The thing is that you need to adopt them in a way that works best for your company. And at the same time, it adheres to some sort of level of standards that can also be applied that when you bring people in, you're not bringing them into some jarring sort of thing. You're bringing them into something that's similar or something that falls in line, at least with minimal deviation, what the definition of a DevSecOps is. Can you have DevOps today without security? Are these really two independent things or should it just be one concept?

You know, they should be the same thing. Here's the thing is, I see this a lot. There's a lot of companies that are like, we'll talk security with them. They'll be like, well, we need to bring the security team in. And some of the questions I always have when I emailing the security team is like, how much delay, how much, you know, hindrance does it put on your organization by having a separate security team? You know, the thing is, is that here's an example. You know, everybody talks about shift left. Where do you put the tooling where it matters most? And where it matters most, actually, is at the developer level, right? This is your entry level. Now, you're not going to have a security person sitting over their shoulder every time somebody codes. You know, this isn't a bullpen.

Right. Or like one of those like margin call bullpens, you know, everybody's sitting around in a cube working and there's a security guy behind him going, you know, you shouldn't do that. Oh, you know what? That's actually an incorrect algorithm you're doing there. Oh, you can be susceptible. You might do a SQL injection, you know, nobody doing that over your shoulder. So being able to have DevSecOps as part of it, security integrated in at every phase. Here's the thing.

People ask me, it's not a point solution. Security should never be a point solution. It should be an iterative solution that goes through the entire SDLC. From the developer level, even we have here, we have a product called curation, right? Which is like a firewall for your organization to intercept requests. And if those requests come in, these are rules and definitions by companies that say, this is a compliance issue. This is a longevity issue. Like, is it operationally risk-averse? Are there malicious packages? But it should be all the way down to runtime. And the thing is, is that every segment along the way is susceptible in one form or another to some sort of security attack. So when people say, is security separate from DevOps? I say, no, because if it is a single point of failure, then you're failing.

Because the thing is, is that there's a lot more space in that spectrum of what SDLC, you know, software development lifecycle. And that should be attributed to every segment of the SDLC from shift left as part of the developer experience down to even code, right? Being able to actually go through and say in Git, we had a big announcement with GitHub this year around things like autofix, like how do you autofix potential security threats and issue? We worked with them on that. Copilot integration. How do I query and find out before I even do my job, if something I want to use to build my software, one of these libraries that's essential, you know, 85% of what I do as a developer is someone I don't know, right? These third-party transit dependencies. Is that going to affect me? Part of the, you know, CLI process.

It should be part of that too, right? Constantly iterating through. And as you build, it should be doing security checks, looking for things like secret detection. Are my applications configured correctly, right? Did I forget to enable TLS on a connection that I'm doing for the service? It should be part of the QA process even. Even as QA is QAing it, they should also be successfully testing it too. And even when it gets to production, you should give one little chef's kiss of security before you deploy it. And then once it's actually been deployed into, say, something like a Kubernetes set or node, you should be constantly monitoring that too. You know, the thing is, we're CNA.

So at JFrog, we're at CNA, which I adore. I think it's one of the coolest things we do. And we have this massive research team. I love going through, it's such a nerd thing. I love going through their research site and seeing what they've discovered. And you'd be shockingly surprised how much security has now become a normalcy, which it should have always been there. It should never have been those guys in the black glasses with the black hats and the shirts that hang out in a room and come out of nowhere and say, you need to fix that because your code is bad. And the thing is, is that there's not enough humans. Usually it's like a hundred developers to like one security person. It's crazy ratio.

So the thing is, security should be part of it. It should automate it. It should be behind the scenes. Plus, it allows the security people to focus on what's important as opposed to a bunch of just minutiae that's out there. They get inundated by this stuff. They're flooded by CVEs constantly. How do you make sure that they're focusing on the right ones? How do you focus on if something's contextually relevant to the issue that's actually being brought up by, say, a vulnerability? How do you know that you're being affected by it? Yeah. I think one of the other challenges as well when you have security, and I think this goes for privacy as well, is these sort of separate teams that are satellited in at the end of a launch to make sure that they bless the thing. It becomes somewhat of a...

antagonistic relationship as well, where they can be seen as sort of the officer. No, because they're coming in at the very last point after people have invested all this time to say, no, you need to go back and redo these types of things. But just to play devil's advocate with this, does moving releases to DevOps, to the engineering team, to those that are building, we're also moving some parts of security there. Are we overloading essentially the engineering teams with too much responsibility by also giving them sort of security to think about? You know what? I'm glad you brought that up, right? That's actually, you know, that's the thing that most organizations, most people I've talked with over time in this industry, they have friends of mine and other colleagues. And, you know, I've been to so many conferences and we've had this debate, you know, how much is too much? And my opinion, and this is very controversial, but my opinion is it's never too much, but it needs to be done intelligently. Okay. So it's not just, is there an issue? This is the nuance.

Because the thing is, say I'm a developer. Now, security, you're telling me now I'm a security engineer besides being a software engineer. So not only do I have to sit there and come up with creative ideas and aspects behind the features and things I'm trying to create, but now you want me to be a security guy? Well, how do you do it in a way that's not intrusive? How do you do it in a way that it feels almost gamified in a way, but also, too, as a way to help the coder actually become a better coder? And that's the thing. It's that fine, nuanced line you have to ride. And I believe it's every developer's responsibility to do this.

Even in the days we didn't have things like SAST, right? That lets me know that you're a bad coder. You did something terrible, right? You shouldn't have done it that way. You know, you would take usually some sort of pen testing. It would take some sort of automated testing, maybe down the road, or maybe a physical test. I mean, I remember the days when we didn't have the automation. You know, we literally had to go through and record the clicks, right? On the, say, the website you were doing, and then it would do the injections and testing like that. It was a very manual process.

By giving the developer the ability to look at their IDE, with the world that they live in, give them all the potential tools that they need to do their job in the world, their house, right? I mean, your IDE is your house. You're in your house. You have different rooms in your house. You have your source code. You have the code you're working on. You have the dependency libraries that you're monitoring. You have all these things. But what if you're able to add that layer of protection to that, to highlight for you, take the ambiguity out of it? And that's the beauty of being able to use tools like Copilot, right? I have a, you know, with Copilot, the stuff we're doing, we did with GitHub, the best part about this is, is as a developer, I can go in and say, show me a better way, or maybe bring up and show me some of the code. And then what they came to us for at JFrog was,

well, what kind of libraries can I use? What are the safe and compliant libraries? Why don't I query in advance? Why don't I go find these things in advance so that we reduce that actual cognitive load I need to do in the security realm? And that's the thing. So when it comes to it, I think that there's never enough, but it has to be done in a way that it's not like suddenly, like I love the fact, would you call it the Ministry of No? Or the Department of No? Yeah, Department of No. I'm going to go with the Ministry of No, though. I like that because that sounds like a very, it sounds very, but the idea is, like I said, you know, when we get back to the idea, like you can't have a security person hovering over your shoulder, whispering in your ear, like creepily saying, you shouldn't do that.

You know, like that could be bad, right? This is one of those ones that, you know, I've shown developers. Like I said, that's my background. You know, I started off as a coder and, you know, done everything. And like I said, I wish I had half the tools. I always go to my IDE. I bring up PS code, which has always been my one of choice, you know, after the acquisition, you know, because it was before. And then I go in and I show you, look, I can still do my job. But at the same time, I now have a bunch of rich information that allows me to do it number one better, right? Takes a lot of the time that would take me to write certain algorithmic functions and stuff.

and do it for me so I'm not just, you know, missing a parenthesis or, you know, whatever. And then on the other side of this, making sure that the things I need to do my job properly, that 85 to 90% of the things I consume are safe, secure, and compliant. And it puts you on a stimulus, you know, it's 100 times more expensive to find a security issue or a security object or some sort of potential threat, nefarious component, whatever, in production than it is at the developer. So, you know, given that we have the growth and interest in DevSecOps and also no shortage of security tools in market and more secure ways of developing software. the problems or challenges that companies face with security incidents, data breaches are not only not going away, they're actually getting worse. So why do you think that there's still this problem despite better tools and practices in place? So it's interesting because one of the things that we addressed here, and this is actually when we were working on it a couple of years ago, my eyes ablaze when I heard what we were going to do and I looked at it.

Because one of the problems is the deluge, right? Yes, this is a systemic problem. It's been a problem for decades, by the way, right? This is not new. It's just become more prevalent. And I think the thing is, is that I don't think we had the tools to see at the time the level of the potential exposure that companies were having. And I think that's the reason why the numbers are so high in a lot of cases. I just think we're more aware, right? We're now more aware. You know, the problems have happened. The knee-jerk reactions are out of the way now. We're on standards, right? You know, when you're looking at things, like I said, like SolarWinds or Log4j, right? Log4j, I mean, let's go back and look at that for a minute, right? I mean, that was the, you know, it's the darling of that library. You know, everybody knows Log4j. And then suddenly, it became the most toxic

You know, and the thing is, the software bill of materials standard came from that and SolarWinds, right? That was like, you know, the government's reaction was like, you know, we got to do something about this. I don't want to say something. I curse like a trucker sometimes. But, you know, this is a thing that we need to react around it. And when we look at this, it's not that it's increased suddenly. I just think we're more aware of it. We have data to back that. And the thing is, is that for us, what made me excited was, is that this constant deluge that developers are like, you know, we started talking to customers and we started looking at reports are like, CVEs aren't that too important.

in a way, because there's so many. It wasn't that they're not important. It's just that how do you constantly, you know, you have an avalanche coming at you of CVEs. How do you pick the ones that you want to address? And what we did is we created this thing called contextual analysis. And with contextual analysis, we actually look at the actual threat parameters of, say, an issue. And we say, are those parameters, are those conditions being met that would cause the potential nefarious exploit, right? And this cuts down the amount of actual CVEs and the amount of potential threats and security issues that our companies we work with have to go after. You know, I showed one customer, they gave us a Docker image. And I ran through our thing and I came back with like 458 CVEs.

Like something ridiculous. And we're like, how long is it going to take you to go through that? And just to find out if you're being affected, not even what level you're being affected, but are you being affected? And they go, probably not. We'll probably go for the critical ones and the CVS score 9.7s and above. And I said, what if I could tell you that 92% of these are not affecting you with certainty? Those conditions for that exploit are not being met. Now you have a small segment of security threats that you can address that's manageable and effective.

Now, like I said, that's the reason why I said, even if there's an increase in security vulnerability attacks, it doesn't mean you're being affected by it because in most cases, it's a singular condition, right? It's a condition that gets met with a parameter, a variable, something that's passed into it, whatever, you know, that causes the exploit or is a change to exploit, it doesn't matter. But the thing is, is that, yeah, there's a sheer scary number out there. That's terrifying. 240 something percent increase like year over year. It's something stupid. Like you go, that's terrible. But you're like, well, you know what though? Just because there's an exploit doesn't mean you're being affected by it.

It's not going to affect you directly. That's the thing. It's like when I look at this, I said, yeah, you know what? Yeah, it's terrifying. Those numbers are terrifying. But here's the thing too, by the way, just quickly, is it's not only are you being affected by it, but if you are being affected by it, how long have you been affected by it? Also too, what other products in your product line might be affected by this? How do you have an audit trail? How do you have accountability behind those components and pieces you use to effectively protect your company or ensure that you have been protecting or to mitigate a disaster that might be PR coming out when somebody finds out that you're being affected by this and X number of millions of user data has just been exposed.

Right. These are terrifying threats that companies think about all the time. And like I said, just because there's a sheer number of increased attacks in the supply chain doesn't mean it's affecting you, but you should be prepared for it. Yeah. So I know that JFrog works with some of the largest banks in the US. Like when we think about like DevSecOps and regulated environments, I guess like what tooling does JFrog provide those companies that helps solve some of these problems that we're talking about?

Oh, absolutely. And that's actually some of the things we were just talking about, right? We actually provide various different levels. And our banks that utilize our platform use large swaths of what we do. You know, our security product called JFrog Security is actually segmented into four different products. We have our standard JFrog X-ray, which is different, by the way, compared to any other security tool. Most security tools are action-based. You need to do something to get some sort of results back to enact some sort of action plan to fix that. With our X-ray product, because of the way Artifactory is symbiotically linked to Artifactory and X-ray, it's constantly scanning. It's constantly evaluating. And it's also, by the way, remember, it's not just one security facet that it should be affected by, right? It's not just CVEs or CVSS.

There's malicious packaging. On top of that, there's licensing and compliance. Read those licenses. You'd be surprised at how many crappy licenses there are out there that are just made-up licenses that say you use us and all your code belongs to us. Small print. And then on top of that is also two things like operational risk. How old or outdated or abandoned are the libraries you're using? Over 80% of the libraries that are out there in the library world, depending on Python, NPM, whatever, are old, abandoned, or outdated. That affects you, too. If you have an issue with a library that you're utilizing that hasn't been updated since 2011...

Good possibility that you're going to have to go hire a company that will rebuild it for you with a fix in place. There's a couple of companies out there that do that, or you're just going to have to deal with it because it's never going to get fixed. So you can write rules on that too. Now we also have advanced security and advanced security allows us to go through and filter through the actual CVEs that are affecting companies, right? Are you being affected by this potentially nefarious moment? Also too, you know, are you doing anything in terms of secrets? Are you exposing? I give you an idea. I downloaded the Docker image. I ran it from Docker Hub, pulled it down. I ran it through our security product and found out I had access to this developers.

AWS keys, you know, his GitHub, everything. I had access, I contacted the guy and he's like, that's impossible. It's clean. I go, did you check your root history? And you go into the image and you type in history and it had everything, everything. And he's like, oh my God. On top of that, we also tell you, are there services or applications that can be potentially threatening in, say, an image that you're doing? We also do infrastructure as code analysis. I messed up once. I was learning Terraform. I did all this stuff. I made my first. I was patting myself on the back. And none of the ACLs, none of the security actions I put in were there. And when I ran it through, I looked ahead. Authorization equals none. Totally rookie mistake, but our product found that. And it let me know. I was like, oh, I'm not crazy.

We also go to the frontline defense on this for them, right? We have curation, which is like a firewall. Because X-Ray and our advanced security is once those binaries, once those libraries, once those nefarious, potentially nefarious components are inside your environment already, potentially, zero days, right? Our curation product acts as a firewall and intercepts the requests for that. It says, I want to bring this library in. What I'm going to do is I'm going to do a dry run to see what things are coming in and stop it before it begins. And then we have companies now that are using, we released this year, runtime. So in other words, now we can trace that security issue from before it comes in, while it's in.

Giving the developer everything they need in the IDE with SAST and all that, all the way down to, is this thing in my runtime environment right now? And how much of a potential threat is it? This is the stuff that we're bringing to banks. And the thing is, is that by having a single holistic security solution allows it so that you're not trying to correlate data after the fact, right? This is correlated data in the same platform, allowing you to have that consistency. Like people ask me if I were to delineate everything we do in JFrog down to one word, I would always say consistency. We provide a level of consistency to organizations so they can reduce the tooling, which means that they don't have tools for all, which also means that there's security gaps and holes. The more tools you have, to be honest, the more holes you have.

because those are interoperable, right? They don't work together. They don't, they're non-interoperable actually with each other. So you have to do manual correlation. And anytime I'm sorry to say this, but we get humans involved, you know, unless it's an innovative kind of thing, we're actually one of the linchpins in something falling apart. Yeah. So you mentioned the guy who accidentally had a bunch of credentials, you know, in the image history. And I think that's like one of those things where you read about like some data breach that was due to weak credentials or something like that. And you're like, oh my God, like how could these people be so like dumb? But like, it's such an easy mistake to make as people. And, you know, like you said, like, you know, a lot of times people are the linchpin in this.

I guess in terms of security issues that relate to social engineering or a person being the fault or point, are there things that JFrog or DevSecOps practices help prevent, things like that? Well, it's funny as you say that, right? I had a chance to meet Kevin Mitnick when he was live, right? I have one of his, I have one of my prized possessions in my home on my shelf is I have one, I even have it on a little stand. I have one of his lockpick business cards. I don't know if you ever saw those because Kevin McClick was the quintessential social engineering hacker, right? I mean, that's how, I mean, he started with the bus system of LA when he was what, 11, you know, and then worked his way up. And you know, the whole idea is most of his hacks were done over the phone. That's a harder thing. Like we don't prevent that, right? I mean, you know, let's be honest, you know, we're the code side. We're the...

We're the ones and zeros, the binary side. Organizations, when it comes to the social engineering aspect, you know, that comes down to, you know, we've all taken those courses. You know, are you compliant? You know, Sally sent you an email and sent you a request to say, hey, I need your social security number. Your mom's, you know, maiden name and your first dog, right? You know, it's like, oh, I'll answer that.

You know, those kinds of things are, you know, somebody calls and like, all right, I was watching, I decided for some reason to start watching Hackers when I was walking, was working out this morning, you know? And, you know, he's like, oh yeah. He's like, look at the little box next to the computer. He's like, and my BLT drive crashed and, you know, I made WOL on this. And I'm like, I'm laughing so hard watching just, you know, 1995, right? But the thing is like, when it comes to social engineering, that's more of education. That's more of like concise guidelines, putting in, you know, processes and things like that. We do it from the automated side. We're the robotic side of the house, right? We're the automated thing. We're the people who give you the notifications that you're doing something terrible and you should fix it.

Hackers and Kevin Mitnick, we're going back in time. It's really taking me back to my early days on the internet. I still have a free Kevin sticker at my office at home. Awesome. Well, you were talking about how one of the things that separates or differentiates JFrog is sort of this more proactive approach versus reactive. Now you're making investments into ML, as many, many companies are. How does that potentially help with proactive? We're entering this era of agentic AI and agentic systems. Suddenly, could we actually have some of these security tools that are actually not only monitoring and alerting, but going and fixing the problems?

I'm glad you said that because actually this is one of the things that we're doing with the, you know, we just introduced, you know, it was actually an acquisition like we talked about before. It was actually called Quack. And now it's our JFrogML product. We also just released our FrogML, which is an SDK to help around this. But the thing is, is that what we've done is, is we've taken our knowledge of say, you know, DevSecOps, our ability to do this, MLOps, we're like, no, this is just an extension of DevSecOps. It really is. When you draw the cross parallels between standard software development engineering and ML engineering, there are, you know, yes, they're different, right? But there's still similarities, right? You're still using Python or R, right? To do, you know, your data analysis, your EDA and all that kind of stuff.

You're pulling in data sources that are out there, right? Hugging face, look at hugging face, millions of repositories, you know, a repository of millions of LLMs and things like that. We proxy those in our company already. We did this before even the acquisition. And we use our security product to scan for things like malicious packaging and licensing and things like that, making sure that you're not bringing in data sets that you're learning to train your potential models with something nefarious, something malicious, something that could be, you know, that could cause a skew, a bias, a hallucination.

in the data. But also, too, remember, things are built on Docker. They're actually deployed. I mean, whether you're working with a GPU or you're working with, you know, a standard CPU. And then being able to go down and have some sort of level of accountability. I mean, we talked about SBOM a little bit over there before, right? You know, the reaction was software building materials. Now there's MLBOM, right? The idea of like, what did I use to train this model, right? There's going to be accountability behind that, too. And now I think the industry is now taking it more seriously. And so for us, you know, we're providing tool sets that are proactive.

We're building a proactive modeling security in this case. We just released our machine learning repository so that people can customize, build, tune, and have a place where they can version models, as opposed to shoving things into an S3 bucket, which makes no sense. We're going back to the days of where we stored third-party transit dependencies before products like Artifactory came out. And the idea is simple. Now, we need to take those approaches. ML is in a wild west phase like DevOps was in the early days. Look at the number of tool sets.

Just Google. Just to be like ML tool sets or ML things. And you get those maps like we used to have. Remember the maps you look at DevOps and it's like, here's all the quadrants of crazy crap. And there's logos you can't read because they're like the size of a dot, right? You know, these kinds of things. And then on top of that, they have the size of a dot. And, you know, now we have the same thing with ML.

Yeah, absolutely. And also, like, you know, I think as much as some of these technologies can bring to automating and help us even, you know, automatically fix some security issues, we're also introducing potentially a lot of, you know, security vulnerabilities, especially ads like, like it is a wild west. We have so many, you know, new tool stacks. They're going to all have these dependencies, could open up a lot of potential supply chain attack scenarios, as well as just like tools that are going to the market, you know, and security is not, you know, job one that they're necessarily thinking about. They're just like, hey, I need to get something out there in order to meet demand and stay on top of sort of the cycle. Yeah.

Absolutely. And the thing is, is now we're going to go into the next phase of this, right? Which is accountability. And now with the accountability side, people are going to start demanding more. And I'm going to say, when I say more, I'm going to say more information on what comprises the things that we utilize and interact with. You know, look at some of the things that are going on, even like at OpenAI, right? With like, you know, ChatGP 4 and 5, right? You know, like the iteration of the models. I know that we've already gone past, you know, I think, I don't think they've told us everything on sentience yet, but I know the thing is, is that, yeah, not only is it preemptive.

And not only is it iterative through the process, but I think we're heading into the accountability phase, which is, you know, we want to know how the soup's made. People are going to want to know from a legal perspective, you know, what kind of challenging data has been attributed to the marvel in which I'm interacting with, right? It's like, there's still a lot of things that I think is shaking out. It did the same thing with DevOps, right? And then DevSecOps. And then we started getting into ML and MLOps. And, you know, what's the next phase? I'm excited. I don't know. I've got some ideas, but I like the idea that I don't know. And I hate to say it though, something is going to have to happen to catalyst that next step. It always does.

Well, Bill, I want to thank you so much for being here. This was really fascinating. I love your passion. It's really energizing. Thank you for having me. I really appreciate it. Like I said, we've all been through a lot in our careers, right? And the thing is, is that I love the ambiguity. I love the future. I love the uncertainty. I love a little bit of that chaos engineering that our life is. So yes, I'm glad to be here and I appreciate it. And it's been a really fun talk. You have some really good questioning and I appreciate it. All right. Well, thank you so much. Cheers. Cheers. Have a good day.

Frequently asked questions

How long is this episode of Software Engineering Daily?

This episode is 50 minutes long.

When was this Software Engineering Daily episode published?

This episode was published on December 17, 2024.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Software Engineering Daily episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.