EPISODE · Nov 1, 2024 · 18 MIN
How To Host AI Locally
from NBTV: Your Money, Your Data, Your Life · host Naomi Brockwell
https://youtu.be/CVeZfM0pVyUhttps://odysee.com/@NaomiBrockwell:4/Local-LLM:dAI chatbots are taking over the world. But if you want to guarantee your privacy when using them, running an LLM locally is going to be your best bet. In this video I collaborate with The Hated One to show you how, and to explain some AI terminology so that you understand what's going on.00:00 Your Data is Used to Train Chatbots01:11 Understanding AI Models01:28 LLM02:23 Parameters03:34 Size04:51 AI Engine and UX07:15 Tutorial, courtesy of The Hated One08:07 Ollama12:40 Open Web UI installation13:23 Docker15:30 Setting up Open Web UI16:38 Choose to Take Control of Your DataThe biggest advantage of open source models is that you can fine tune them using your own instructions while keeping all data private and confidential. Why trust your data to someone else when you don’t have to?A huge thank you to The Hated One for his tutorial.You can find his playlist for staying anonymous here:https://www.youtube.com/watch?v=G_QsQp7DyjE&list=PLR_ghQEN2SgDLpuLMLa_0hjJZgrlHoi0aBrought to you by NBTV team members: The Hated One, Reuben Yap, Lee Rennie, Cube Boy, Sam Ettaro, Will Sandoval and Naomi BrockwellTo support NBTV, visit:https://www.nbtv.media/support(tax-deductible in the US)Visit our shop!https://Shop.NBTV.mediaOur eBook "Beginner's Introduction To Privacy:https://amzn.to/3WDSfkuBeware of scammers, I will never give you a phone number or reach out to you with investment advice. I do not give investment advice.Support the show
NOW PLAYING
How To Host AI Locally
No transcript for this episode yet
Similar Episodes
No similar episodes found.