Skip to content
Ai_010 - Tools for Running Local LLMs episode artwork

Dec 14, 2023 39 min

Ai_010 - Tools for Running Local LLMs

from Bitcoin Audible

Today we dive into a few of my favorite tools for running LLMs locally on your machine, even the average consumer machine. With a huge variety of models to choose from and varying levels of customization and presets, these will get you started on running your own Ai, and getting the pieces necessary to connect them into micro apps and other parts of your workflow. Not only are these huge productivity boosters to have, but it's also just a ton of fun to play around. For the large list of links to these and so many other AI tools to check out, go to bitcoinaudible.com/ai (Link: bitcoinaudible.com/ai) Links to the tools and the models mentioned in the episode GPT4All (Link: https://gpt4all.io/index.html) LM Studio (Link: https://lmstudio.ai/) Ollama AI (https://ollama.ai/) Models mentioned Stablelm-zephyr (small & fast) Mistral Instruct (good overall, imo) Hermes (less likely to lecture you) Llama2 (great base model) Llava (text and images, multimodal) Host Links ⁠Guy on Nostr ⁠(Link: http://tinyurl.com/2xc96ney) ⁠Guy on X ⁠(Link: https://twitter.com/theguyswann) Guy on Instagram (Link: https://www.instagram.com/theguyswann) Guy on TikTok (Link: https://www.tiktok.com/@theguyswann) Guy on YouTube (Link: https://www.youtube.com/@theguyswann) ⁠Bitcoin Audible on X⁠ (Link: https://twitter.com/BitcoinAudible) The Guy Swann Network Broadcast Room on Keet (Link: https://tinyurl.com/3na6v839) Check out our awesome sponsors! Fold: The best way to buy, use, and earn #Bitcoin on everything you do! Sats back on your debit card, gift cards, auto-buys, round-ups, you name it. Fold is the true bitcoiner's banking. Get 20K sats for FREE using referral code bitcoinaudible.com/fold Ready for best-in-class self custody? Trying to BUY BITCOIN? River, secure, trusted, bitcoin only, lightning enabled, simple. (Link: https://bitcoinaudible.com/river) Bitcoin Games! Get 10% off the best Bitcoin board game in the world, HODLUP! Or any of the other great games from the Free Market Kids! (Link: https://www.freemarketkids.com/collections/games-1) Bitcoin Custodial Multisig Want to get into Bitcoin but not ready for self custody? Use custodial multisig for the best way to distribute trust across multiple institutions and even jurisdictions! Check out OnRamp. (Link: BitcoinAudible.com/onramp) Education & HomeSchooling Get the lesson in real economics that you never got in school, and teach your kids the truth, not the statist insanity that is Keynesianism. Liberty Classroom is the invaluable resource you are looking for! (Link: BitcoinAudible.com/Liberty)

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Ai_010 - Tools for Running Local LLMs

0:00 39:46

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Bitcoin Audible?

This episode is 39 minutes long.

When was this Bitcoin Audible episode published?

This episode was published on December 14, 2023.

Can I download this Bitcoin Audible episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.