Skip to content
Tomorrow's Syntax: Bito CEO Amar Goel Talks AI's Future in Coding episode artwork

Feb 8, 2024 23 min

Tomorrow's Syntax: Bito CEO Amar Goel Talks AI's Future in Coding

from The Daily AI

In this episode, we dive into the future of coding with Bito CEO Amar Goel, exploring how AI is set to influence syntax and reshape the coding landscape, offering a glimpse into the coding practices of tomorrow. Invest in AI Box: https://Republic.com/ai-box Get on the AI Box Waitlist: ⁠⁠https://AIBox.ai/⁠⁠ AI Facebook Community Learn more about AI in Music Learn more about AI Models

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Tomorrow's Syntax: Bito CEO Amar Goel Talks AI's Future in Coding

0:00 23:31
of matches

Transcript Auto-generated, may contain errors

Every great business starts as a dream, but turning that dream into reality? That's where Shopify comes in. Shopify is the commerce platform behind millions of businesses around the world, and 10% of all e-commerce in the US. From household names like Mattel and Gymshark, to brands just getting started.

Worried about building a website? Shopify's ready to use templates helping your brand to life. Need a hand with content? Shopify's AI tools generate product descriptions, headlines, and even enhance your images.

Struggling to get noticed? Shopify's marketing tools let you launch email and social media campaigns with ease. And if you ever get stuck, Shopify's award-winning 24-7 support is always there to help. Turn those what-ifs into why-nots and give them the best shot at success with Shopify.

Sign up for your $1 per month trial and start selling today at Shopify.ca. Now, Shopify.ca, it's time to see what you can accomplish with Shopify by your side. Welcome to the AI Chat Podcast. I'm your host, Jiden Schaeffer.

Today on the podcast, we are thrilled to be joined by Amur Goel, who is a co-founder and CEO of Bito, which is a groundbreaking technology company that leverages AI to accelerate software development and enhance developer productivity. So prior to Bito, he actually founded Pubmatic, which is a digital advertising platform that won public in 2020. It's traded on the NASDAQ. And Amur brings a wealth of experience from roles at Microsoft, McKinsey, Netscape.

And what I believe really makes him a lean voice in the whole, you know, the intersection of AI and software development. So welcome to the show Amur. Thanks so much for having me. Excited to be here.

Super excited to have you on the show today. I want to kick it off and kind of ask you a little bit about yourself and your background. You know, in technology, you know, you've worked in the space for a while now. Is this something you always knew you were interested in, specifically like AI and stuff?

Or is this something that, as your career developed, you kind of got pushed in this direction? You know, what's your background? Yeah, I mean, I think I've been interested in software for a long, I mean, that's kind of like really love building products and building companies for a long time. I started a company when I was in college and I kind of used to do randomly kid.

But I would say like AI is newer in the fernie in the sense of, you know, I'm former company Pomatic. I started I used to run machine learning team there. So something that, you know, I would say classically I'm more like a product type person on that, but building technology company is something that I'd love to do. Sure.

So would you be able to tell me a little bit about, you know, what inspired you to start bit, Oh, and kind of this new phase of what you're working on? Yeah. We started actually end up doing a little bit of a pivot. We started with a focus on developers when started the company.

I mean, my two co founders and really our focus was how do we help developers collaborate, you know, better. And so we really want to be in the tools that developers use on a kind of regular daily basis, but really how do we help them, you know, like as a collaborate, kind of bring a Google Docs and slack type experience to the idea and what everyone was like, Oh, this is super cool. I love to use it. And then nobody choose it.

So that we started listening to that feedback and we started trying to think about what are the different ways that we could help them and they said, Hey, can you help us understand code on board new engineers? And then that's really how we started spending more time with large language models and AI and really, you know, end up launching kind of the current, you know, bito in December of 2022, which is today is really an AI assistant that helps developers. So it's really a tool that developers can use. It kind of works in their ID or their CLI and they can use it to, you know, write test cases, write code, explain code.

Actually, the number one thing to do is explain code, debug, you can just sort of debugging areas right into it. So it's a little bit like it started out as kind of like a chat GPT in your IDE. Really where we're going is that, you know, we're building all these capabilities that really help them do things in more automated fashion. So we have agents that like you like automatically document your entire set of files or repository of code.

You can write test cases. So all kinds of things like that. We have about a hundred thousand developers are using today. Very cool.

Wow. That's incredible. And I think, you know, big kudos to you for a lot of people, I feel like starting a company do not have the, perhaps the vision when something isn't going exactly how the original hypothesis is to be able to make that pivot and get take on that feedback. So big kudos to you for taking that and obviously, you know, seeing the reward of that hundred thousand developers is incredible.

What is, I'm wondering if you have kind of like a case example or, you know, of someone that is used this and really successful or kind of the ideal person and maybe a success case using this? Yeah. So I can give you kind of two. So we have like a very large transportation company that said, Hey, we have all these, you know, apps that they're running, but we, they're not well documented.

No one's really are here exactly how they work. Could we use Vitto to kind of automatically document because we want to migrate them. They're older apps and we want to migrate them to more of a moderate kind of market. Well, first we need to really understand what they're doing.

And so they're using Vitto to just like automatically document those apps and they have like close to 50 of them. And so I think that's, you know, pretty, pretty cool that they're able to like, you know, we're taking like thousands, you know, hundred of hours and they're, you know, able to do it, you know, in a minute. And then it changes. You may go out and I can get an update, right?

So I think that's kind of like one, you know, interesting kind of use case. I'll give you two more quick ones. One is that some engineers are pomadic or actually using it to like, they were saying, Hey, how can I use it for testing? And so one of the things that they did is that they actually asked Vitto to take some code and then said, give me ways to break this code.

And then they turned those ways that I suggested to break the code and they turned that into test cases. So now they added that to the test suite. So for example, they were like, Oh, like it was accepting some input that code is accepting them. But so they're like, the thing said, Oh, well, it doesn't really do much handling to take malformed inputs, you know, like, you know, maybe somebody can upload a script that runs, you know, right.

So then they use that to then turn those into test cases and not anytime somebody continues to have to go, they run these test cases to make sure that the code's more hard, you know, very cool. So yeah, so I know that was kind of interesting. And then the third one would be really quick is my nine year old key. He's like learning the program, but to be honest, he's funny to watch him.

He's like a program. Like, you don't really understand how the code works, but AI helps him kind of advance and be a little bit like supercharged. So he basically said, Hey, write me a Chrome extension. Him and his brother were trying to trade Pokemon cards.

He said, I want to give you a name of a product. I want you to write a Chrome extension that like automatically searches eBay for those products and brings me back an order list by Christ. And I wrote the whole Chrome extension in like one minute for him and then he just followed the instructions and set it up. So you know, those are kind of, you know, three interesting use cases where super cool.

That's that's the protocol. One thing I would love to ask you and get your feedback on is, you know, from your perspective in some of the things you've seen, right, you launched this thing back in December. What are the ways you see AI really shifting, like even from the beginning of the year till now, right? You may pivot in your company, but what are the ways you're seeing the landscape of AI shift?

What are some things you're seeing on the future? Yeah, I think it's a really good question because I think sort of the laws of gravity are occurring, you know, when it comes to like all the AI innovation happening. And what I mean by that, if you remember, but so far back as November, December last year, when you went to do when Chachi D launch, right, I mean, you're in the AISB two obviously, like it was crazy about like every day some announcement would come out like a world was changing or somebody would say, I just wake up this amazing thing over the weekend and they would launch it on Twitter, X or whatever. It was kind of like, just seemed like everything was changing like overnight and people were talking about like, you know, it was their job in 15 minutes and like, oh, the software's dead and like we don't need software developers anymore, right?

We're gonna lose our job. But we know all these things are out there, right? And I was like, it was really cool to like, you could do things really quickly and you could bring up this little like 30 second demo of like, hey, I took one hour and I kind of changed thing. And I think now we're, you know, here we are fast forward, let's say like nine months, you know, if you look at Twitter, you know, you look at like just, there's a lot of the announcements still happening.

So I'm not trying to say it enough. Maybe instead of three unbelievable things happening every day, it's kind of like, yeah, I'm one amazing thing is happening a week now. And maybe it'll be like, you know, one is happening a month, you know, because I think the bar kind of going up and, you know, and we're also in this phase now where to actually turn like that little quick demo that you wrote into like a real product that people can use that actually works repeatedly well, gives you kind of the similar output, you know, that is turning into a lot more work. And so I think what's happening is that people are realizing that like, it's like everything's going to change, but maybe not in like 15 minutes, it's going to probably get some years of change.

And then maybe one last thing I'll mention about this. I think users, consumers, business people, engineers, whatever, like changing behavior doesn't happen overnight, you know, so people are, they are kind of used to doing things a certain way and adopting new ways of doing things isn't always like easiest thing. And so we even noticed that in our product, you know, people will be like, oh, this is really cool, it can do all these things. And then, you know, maybe we'll look at some users who stopped that lot from using it and they'll be like, oh, I just kind of forgot about it, or I kind of just ended up going back to the way I was doing it.

Or if you look at like chat GPT, you know, there's been all these articles kind of saying that, you know, use the docs, you went up crazy and then it's kind of flattened and even coming down a little bit, you know, the last few, yeah, and there's some different arguments about kids are in school, just not needing to cheat as much. But you know, the point is that like you talked to a lot of people today who were like, oh, yeah, I have a chat to be a scripture matter where they use it. You know, so human behavior and even just understanding how to use these new tools takes time as well. Yeah, 100% agree.

I'm adding to my project. You're working on it. Definitely. Yeah, I think, I mean, of course, there's like the novelty of everyone to try chat GPT to just see what it can do.

But then it kind of comes down to like who's, you know, actively using it in the work. Like, I know for one, I would be, I'd be doomed if I didn't have chat GPT to help me prep for podcasts and like so much stuff I do. It's kind of interesting because essentially what I've done is I pretty much scaled up my outputs, my business outputs to like maybe like 5x what I was doing before. And it's like, if I did not have chat GPT, this would be unsustainable.

I would be, I'd be completely doomed. So it's kind of funny that I feel like that's like a big pivot. But like again, you know, some people, if they don't have it figured out into the workflow, they'll just continue using it. But if you find it for something and you can use it for something that's repeatable in your workflow, like you're never going to give it up because it's too valuable.

One thing I would, I'd love to kind of ask you about if I'm from you is, you know, as far as like BitBose kind of AI code assistant goes, I'm wondering like, how does this differ from competitors? Of course, there's like, you have CoPilot and there's these other ones. How does this kind of differ in terms of like understanding the context of, you know, a developer's project and that kind of stuff? Yeah, no, it's a great, great question.

You know, I think one of the things that we really are, you know, focused on is like, how do we really understand, you know, the developer and their context like you were kind of mentioning. And so for example, like we index your entire code base and allow you to answer questions or work on your existing code, you know, you know, CoPilot today is really just like as you type a line of code, you can complete it, but you can't really help get interactive, you know, chat. I mean, they're working on some of that stuff for sure. And I know, you know, we're really trying to think about how do we help that developer really understand their code base and use AI on that.

And we want to help you really understand kind of all that stuff going on in your organization and helping use, you know, the AI on that. And I think that's one of the reasons we're seeing like so much adoption is that like it's a versatile tool. You can use it to do code completions, you can use it to do chat and you can do it, you know, use it in a lot of different ways in a very flexible set of weights. Mm hmm.

Okay. Very cool. Something I would be curious to hear your opinion on as well as like, you know, obviously this is a, this is a big field. What are some of the main challenges that, you know, you guys are facing right now in, in rolling these tools out and rolling, you know, bitto out to people?

It's, you know, it's a very ambitious vision, I feel like, for a company. So, you know, what are some of the big challenges that you are up against and some of the things you're doing to overcome. Yeah. I mean, maybe the only two things.

One is around kind of like ease of use. And then the second is maybe around cost of AI models. So the first one, he's a view. So, you know, we've taken a PLG product led growth approach, right?

Which is that we want it to be super easy to get going and started with our product. You know, you can literally sign up and start using it within like two minutes. And you know, often running, we wanted you to get to that aha moment, you know, very, very quickly. Now, cool.

So, you know, one of the things is, for example, like when we try to index your whole codebase, you know, there are some other tools out there that you do that, but you have to set up a separate app and you know, can literally take like an over app and you're going to go you know, publish an endpoint and set up the server. I mean, it turns into like a whole project, you know, we actually write on your machine, like deploy a vector database and build kind of all these, you know, index of vector index of all of your code and locally on your machine for security reasons. So that it's not like in the cloud, but you know, we try to make it so that the user not to change anything. Literally, they just had to say accept like I want to do this.

Cool. And so let's take a lot of energy and work to kind of make that happen in a very seamless, easy to use way. I think that if you had like three hours of work that you had to do to enable that, I think that that wouldn't be, you know, a lot of users wouldn't be interested in trying it out, you know. So yeah, today we only really offer that for our paid users, but we're trying to think about how to offer that, you know, for all of our, you know, for all of our free well.

And so that's something that, you know, goes back to the kind of your question about like, hey, these are some of the types of challenges like an appeal to model, trying to make it super easy to use the product and, you know, not all this configuration installation kind of that's the second thing maybe I'll mention you were asking. The second thing I was going to mention was around kind of AI model cost. So, you know, these AI models are not cheap. It's at a whole different level of cost than normal compute.

You know, there's so many services where people are like, oh, yeah, it's free to use because they're like, oh, you're just using a little bit of like, you know, AWS compute time or, you know, compute time costs us a couple cents a user a month or if even that. Well, that's not really the case in the AI tools if you're really aggressively using that, you know, like you can easily spend several dollars a month on a for a user, you know, if they're really querying in a lot and running a lot of GPG or queries or, you know, and drop it has a great model called to that we use, you know, like those things can really add up in cost. And so, you know, people will be like, well, I want access to this thing, but I don't want to pay. And so, you know, we of course want to give them a really robust product, but we're all in regard, like, how do we do that, you know, in a way that is cost effective, a is a price that they're willing to pay, but be also then, you know, hopefully over time, we'll have some margin, you know, to build some revenue for our company.

And you do have, there's a long term thing, which is like, you know, that there's a bit of a Moore's law happening on these AI models and over time, the cost is going down as, you know, compute gets cheaper. But in Iran, you know, that's not always exactly the case. Right. Okay.

Very cool. One thing that I would love to ask you about is what are some of the things that you get, you know, what are some of the things that you're currently working on that you're really excited for in the future, like some maybe like future features or the kind of future direction you guys plan on going, this is a really interesting space. And like you mentioned, like there is a lot of competition, there's a lot of people kind of looking at it on big players and whatnot. I'm like really impressed that you guys are like doing this as a startup and you're getting in there and like you've just done so much on blown away.

And I think maybe one of your competitive advantages is having that kind of more agile scrap your team versus something like a GitHub co-pilot, you can get a lot of these like innovative things down very fast. But you know, just curious, like what are some of the things you guys are looking forward to in the future and excited about there? Yeah, I know it's a great question. We're definitely trying to move really fast.

And I mean, you think that's kind of one of our superpowers, if you will, is to be agile and try to move quickly. And you know, there's just a few of us that kind of work to make some of these decisions. We don't have like a whole thing by committee or, you know, whatever, like a bigger company. So yeah, I mean, I think a couple of really interesting things.

So we actually have like a code completions product launching in October, which we're pretty excited about. So this will be a little bit of like, you know, as you type will complete a line of code or you can put a comment in your code, we'll write the whole block of code. And I think one of the things that we're really bringing to that, which is different than everybody else out there is like, we really do understand your code base. And so you can use that to actually really write much better code, right?

We understand the functions, the methods, you know, the variable names that you're using. And so we can really use that to really write much more code that I think really is much more relevant. And so we think that, you know, we can help developers maybe, you know, write as much as like half of their code. So I think that's kind of something that we're, you know, pretty, pretty excited about.

And then I think, you know, the other thing I'll mention is that we're really doing a lot of work on our agent. So we have some initial agents that we put out there, like one for, I think I mentioned briefly before, but like for, you know, test animations or the right test cases, not yet one for documentation. But you know, those are still, you know, they're early, they're kind of, you know, alpha kind of versions, but we're doing a lot to like really improve those and make those more and more robust. And so every week we're trying to really improve those and add more, you know, things around that we have some other things we're doing around code review agents that we're hoping to launch, you know, later this year.

So I mean, really excited about all these things. I mean, today our average user tells us that they don't make some 31% more productive. Which, you know, you kind of think about that, like I didn't think it was going to be that high actually, including just like serving our users, right? We're like, hey, you spit out how much more productive does it make you?

And we're bunch of, I mean, 31s the average, right? So of course, there are a bunch of people that are making like 5% more productive. We give up our users who said, oh, it makes, I think that there was like more than 25% of people that makes them more productive. Oh, wow.

Yeah. And I kind of feel like we're just getting started, you know, so I think maybe from where we are by the end of the year or maybe from sitting here in, you know, September 2023, where we are a year from now, I'm actually hoping that we can say, yeah, we make people like 100% 150% more productive, which if you think about that, like we're focused on professional developers and helping them in their jobs, like think about it in the work context, like, you know, a developer, you know, companies spend, let's say $150,000 a year on developer, like a if you could be 100% more productive, it's like, wow, it's a huge return on our eye. But I think yeah, maybe more interesting is that like for the developer themselves, we think that we can remove a lot of the kind of drudgery of work that's been out there. I mean, there's been this whole kind of push the last like 70 years called shift left in the development world.

Oh, we should include security earlier in the process than you write more secure code. We should make test earlier in the process. So then you have more, you know, you better test it code more code covered and all that's kind of ended up on the developer's plate. And so the developers like, I'm supposed to become an expert in everything like CI CD, I'm supposed to become an expert in, you know, security, static code analysis, open source vulnerabilities, I'm supposed to become an, you know, expert in test coverage, test framework, unit test.

So all of these things are like, they are making better code, we are having more secure, you know, better performing code. But at the same point, the developers like, I'm not getting that much time to actually just work on the stuff I want to work on, which is like thinking about how to design a good solution and then in that executing. And so we think that a lot of these AI tools can eliminate a lot of that work that frankly a lot of developers don't consider like that core to what they're doing. And there are a lot of that documentation, you know, like all that stuff just be handled for them.

And so developers can kind of get back to almost like having fun and doing the work they want to do. Very cool. Yeah, I think that's, I think that's incredible. You guys are doing some really cool stuff.

So definitely this is a company that I'm going to be following along on the journey and watching what you guys are doing for people that want to, you know, find out more about you guys and you know, maybe give a try. What's the best way for people to find video? Yeah, I mean, just check out our website, bit.io.ai, bit.io.ai. And yeah, right from there, you can like I said, sign up in, you know, one minute and get going.

We have, we have plugins for visual studio code IDE, we have plugins for all the Jetbrains IDEs, the PyCharm, GoLang, Ruby, you know, all the different languages that Jetbrains supports Android Studio, et cetera. We also have a CLI so you can run away from your command line interface and we have a Chrome extension and a web app as well. So we kind of cover kind of all of your bases. Very cool.

Awesome. And I'll make sure for the listeners I'll have a link in the show notes to video. You guys can go check it out. Um, Um, thank you so much for coming on the show today.

Thank you so much for sharing your story. The insights and some of the cool stuff you guys are working on. I'll have to have you on another time to the listeners. Thank you so much for tuning into the AI chat podcast.

Make sure to rate us wherever you get your podcast and have an amazing rest of your day. Thank you for listening to today's podcast episode, breaking down how AI is impacting your industry. Today's episode is sponsored by AI box, a no code AI app builder and marketplace, which just launched a crowdfunding campaign. If you are interested in investing in a new AI startup, you can go to republic.com slash ai dash box.

I'll leave a link in the show notes as well to learn more. The minimum investment is $150 and the maximum investment is $100,000. Until next time, have a fantastic day.

Frequently asked questions

How long is this episode of The Daily AI?

This episode is 23 minutes long.

When was this The Daily AI episode published?

This episode was published on February 8, 2024.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this The Daily AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.