PodParley PodParley
How To Host AI Locally

EPISODE · Nov 1, 2024 · 18 MIN

How To Host AI Locally

from NBTV: Your Money, Your Data, Your Life · host Naomi Brockwell

https://youtu.be/CVeZfM0pVyUhttps://odysee.com/@NaomiBrockwell:4/Local-LLM:dAI chatbots are taking over the world. But if you want to guarantee your privacy when using them, running an LLM locally is going to be your best bet. In this video I collaborate with The Hated One to show you how, and to explain some AI terminology so that you understand what's going on.00:00 Your Data is Used to Train Chatbots01:11 Understanding AI Models01:28 LLM02:23 Parameters03:34 Size04:51 AI Engine and UX07:15 Tutorial, courtesy of The Hated One08:07 Ollama12:40 Open Web UI installation13:23 Docker15:30 Setting up Open Web UI16:38 Choose to Take Control of Your DataThe biggest advantage of open source models is that you can fine tune them using your own instructions while keeping all data private and confidential. Why trust your data to someone else when you don’t have to?A huge thank you to The Hated One for his tutorial.You can find his playlist for staying anonymous here:https://www.youtube.com/watch?v=G_QsQp7DyjE&list=PLR_ghQEN2SgDLpuLMLa_0hjJZgrlHoi0aBrought to you by NBTV team members: The Hated One, Reuben Yap, Lee Rennie, Cube Boy, Sam Ettaro, Will Sandoval and Naomi BrockwellTo support NBTV, visit:https://www.nbtv.media/support(tax-deductible in the US)Visit our shop!https://Shop.NBTV.mediaOur eBook "Beginner's Introduction To Privacy:https://amzn.to/3WDSfkuBeware of scammers, I will never give you a phone number or reach out to you with investment advice. I do not give investment advice.Support the show

NOW PLAYING

How To Host AI Locally

0:00 18:15
Play in mini player Transcript not yet generated

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

URL copied to clipboard!