Manufacturing is never simple, but Epicord makes it easier. Our industry-built ERP and AI tools help you increase throughput, reduce downtime, and improve cash flow without any complexity. If you're ready to run a smarter, more efficient factory, visit epicord.com. Really the headline here is that in a move aimed at kind of intensifying its position in a very crowded generative AI sector, Meta has open-sourced CodeLama, which is an advanced machine learning system capable of generating and explaining code in natural English, right?
So it can generate the code on one hand, and it can also explain what is, you know, happening in that code. So this release comes on the heels of other AI models by Meta for tasks like text generation, language translation, and audio creation. Meta has really been pushing, like, hard. They've been at the forefront, and I will give them credit in a sense that everything they've been pushing is not a productized product.
Essentially, they're releasing a lot of these as open-source systems. A lot of these are things for researchers and developers to use, and you have to give them a lot of credit for that specifically. A big part of this is they want to make sure that they have the most cutting-edge AI researchers on their team at Meta, and so this is a good way for them to, you know, say, look, we're creating cutting-edge stuff, and we're releasing it, and it's getting users, and that's a really big part of attracting top talent. And so I think Meta is doing a great job.
I still think, like, it's really interesting that left to be seen whether they're going to try to productize this, whether they're going to try to turn these into, you know, like, revenue-generating streams. I think really the machine learning system is an offshoot of Lama 2, which is a text-generating model. Meta had previously kind of open-sourced, but unlike its predecessor, which can generate code, but kind of lacked quality, right? Lama 2 wasn't known for incredibly high-quality code, but unlike that, Codelama is a lot more focused and sophisticated.
So the training data for Codelama includes a mix of publicly available sources, and it kind of emphasizes the relationship between code and natural language. So Codelama models come in a bunch of different, you know, flavors, you could call them, with each parameter sizes ranging from 7 to 34 billion, and it was trained on a massive amount of around 500 billion tokens of code-related data. So some specialized versions are kind of optimized for Python and understanding human instructions, with others being fine-tuned to generate helpful and quote-unquote safe answers, and it's up to you which one you'd like to use. So for those unfamiliar with machine learning terminology, parameters are essentially the learned parts of a model that essentially define its capabilities to solve problems like text or code generation.
So tokens, on the other hand, represent just raw text data, right? Like how much data went into text and train this. So the expansive parameter count of Codelama really kind of reflects its ambitious capabilities. Meta says that their 32 billion parameter model is the most effective code-generating model that has been open-sourced so far.
And I think the potential impact of a tool like this is, it's really big. I think it's also especially given that GitHub's Copilot is already in use by over 400 organizations. And, you know, like I, for one, have many of my developers that are using GitHub Copilot to build things that are seeing some really solid gains from it. But apparently it's increasing developers' coding speed by around 55%.
This is according to GitHub's claims, of course, so cake with the grain of salt. But additionally, a recent survey by Stack Overflow found that 70% of developers are either already using or plan to use AI coding tools this year. And I also have a lot of developers that aren't necessarily using GitHub Copilot but are literally just using GPT-4, asking questions about code and getting really good insights and responses. Now, of course, it's not perfect.
They say a lot of times they'll gaslight them about a question driving crazy. But at the end of the day, it does have a lot of really good tips and it helps a lot with coding. So, I mean, for all the gaslighting, they continue to use it instead of live without it and use it every single day. So it's got to be doing, you know, something pretty solid.
However, I do think that the rise of these kind of AI-assisted code, these aren't without the pitfalls, right? Research conducted by a team affiliated with Stanford revealed that these tools can inadvertently introduce security vulnerabilities into applications, which is definitely a concern for virtually every developer. I think that there's also the kind of contentious matter of intellectual property. So some code-generating models are trained on copyright material, which is potentially, you know, having some big legal risk to businesses.
Code Lama is not entirely foolproof either, right? This new one that's just coming out. I think while it won't actually generate ransomware code, if asked directly, it will comply with requests when, like, if you ask it and you frame it in a less, kind of like a roundabout way. So Meta acknowledges this in a blog post advising developers to conduct safety testing and tuning specific to their application of the model before deployment.
But despite all these challenges, and right, there are a lot of risks, I think Meta really imposes minimal restrictions on code Lama's usage. So unlike other versions, I believe Lama, like the first version of Lama, they came out with had like a ton of usage restrictions. You weren't allowed to use it for corporate anything. You were only really allowed to use it if you were a researcher just testing it.
So it's really, I don't know, super useful. This is different around essentially just requiring that the model not be used for malicious activities and that a license be requested if deployed on a platform with more than 700 million monthly active users. So that's right. There's a handful of companies in the world that have that, but if you're going to use it on a platform with more than 700 million monthly active users, you're going to want a license.
Otherwise, pretty much anyone can use it. And then the thing with, you know, not having malicious activity, like obviously that's just in everyone's terms of services, you know, goes without saying, I'm sure malicious people use it, but at least Meta can say we told you not to, right? So I think Meta aims for code Lama to find applications across diverse sectors, such as research industry, open source project, NGOs, businesses. And I think it's really hoping that it's going to inspire development of new tools and commercial products based on really kind of the Lama 2 model.
So very interesting space to watch and it looks like an incredibly useful tool. Thank you for listening to today's podcast episode, breaking down how AI is impacting your industry. Today's episode is sponsored by AI Box, a no-code AI app builder and marketplace, which just launched a crowdfunding campaign. If you are interested in investing in a new AI startup, you can go to republic.com slash AI-box.
I'll leave a link in the show notes as well to learn more. The minimum investment is $150 and the maximum investment is $100,000. Until next time, have a fantastic day.