Ai_010 - Tools for Running Local LLMs

from AI Unchained Hosted by Guy Swann

Today we dive into a few of my favorite tools for running LLMs locally on your machine, even the average consumer machine. With a huge variety of models to choose from and varying levels of customization and presets, these will get you started on running your own Ai, and getting the pieces necessary to connect them into micro apps and other parts of your workflow. Not only are these huge productivity boosters to have, but it's also just a ton of fun to play around. For the large list of links to these and so many other AI tools to check out, go to bitcoinaudible.com/ai (Link: bitcoinaudible.com/ai) Links to the tools and the models mentioned in the episode GPT4All (Link: https://gpt4all.io/index.html) LM Studio (Link: https://lmstudio.ai/) Ollama AI (https://ollama.ai/) Models mentioned Stablelm-zephyr (small & fast) Mistral Instruct (good overall, imo) Hermes (less likely to lecture you) Llama2 (great base model) Llava (text and images, multimodal) Host Links Guy on Nostr (Link: http://tinyurl.com/yc376bff) Guy on X (Link: https://twitter.com/theguyswann) Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible) Check out our awesome sponsors! Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://www.swanbitcoin.com/)

Episode details come from the podcast's RSS feed.

Embed this episode

Attribution link and audio player

Ready to play

Ai_010 - Tools for Running Local LLMs

0:00 39:47

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world. Epic: Silver Wing Realm EPIC is your new HQ for Realm’s exhilarating action and adventure stories, with new episodes dropping every Monday introduced by host Faith McQuinn. Embark on your greatest adventures yet, whether it’s crash landing on a desolate planet with only a cerebrally-embedded AI to guide you, or realizing that your latest game design is the only thing staving off total global annihilation. So unsheath those earbuds, clench that steering wheel, and buckle up because EPIC is about to take off. This month, we are featuring Silver Wing: On a desert planet in the far future, an old dragon hunter embarks on a desperate journey to save her estranged son. For centuries, the dragons have been sleeping. But in their rest, they provide a crucial energy source necessary to keep the planet Toon Flats habitable. Amphet Dahl is a diviner, gifted with the ability to sense the dragons’ dreams and memories and to the disappointment of her son, Afton, she uses this ability to

Frequently asked questions

How long is this episode of AI Unchained?

This episode is 39 minutes long.

When was this AI Unchained episode published?

This episode was published on December 14, 2023.

Can I download this AI Unchained episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.