Ai_012 - A Big Leap Forward for Local LLMs

from AI Unchained · host Guy Swann

The models, the tools, the implementations, everything is moving incredibly fast. But a very interesting trend that I've been seeing, is that the open source benchmarks are improving just slightly faster than the closed source alternatives. Slowly but surely, they are catching up. The day may come where the open source models are the best models, the ones with the greatest number of tools, and the largest variety of implementations, because naturally they're open and available for everyone to work on. There have been numerous new developments on running models more efficiently, running larger models on even smaller devices, and doing so with less power and computational overhead, as well as a new advancement in one of my favourite open source models, which may just be a big leap forward for how these are going to evolve moving forward. And that is what today's episode of AI Unchained is all about. A big leap for local LLMs. Ai News Roundup Running Ai locally on a Smartphone: A Performance Evaluation of a Quantized Large Language Model on Various Smartphones (Link: http://tinyurl.com/mv4k7eyp) LLM in a flash: Efficient Large Language Model Inference with Limited Memory (Link:http://tinyurl.com/mrc5ur7m) Explore the new Mixtral Model below Poe.com (Link:https://poe.com/chat/2vdailufawo9jnkcb4l) Fireworks AI Models (Link: https://app.fireworks.ai/models) GGUF Model for Local Running (Link: http://tinyurl.com/34btrnre) Run with LMStudio - LM Studio - Discover, download, and run local LLMs (Link:https://lmstudio.ai/) Unleashed Chat - One button to deploy your own chat (Link: https://unleashed.chat/app/chat) Host Links Guy on Nostr (Link: https://tinyurl.com/yc376bff) Guy on X (Link: https://twitter.com/theguyswann) Bitcoin Audible on X (Link: https://twitter.com/BitcoinAudible) Check out our awesome sponsors! Get 9% off the COLDCARD with code BITCOINAUDIBLE ⁠⁠⁠⁠⁠⁠(Link: bitcoinaudible.com/coldcard⁠⁠⁠⁠⁠⁠) Swan: The best way to buy, learn, and earn #Bitcoin (Link: https://swanbitcoin.com)

Episode metadata supplied by the publisher feed · Published Jan 5, 2024

Embed this episode

Attribution link and audio player

NOW PLAYING

Ai_012 - A Big Leap Forward for Local LLMs

0:00 50:49

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world. Epic: Silver Wing Realm EPIC is your new HQ for Realm’s exhilarating action and adventure stories, with new episodes dropping every Monday introduced by host Faith McQuinn.Embark on your greatest adventures yet, whether it’s crash landing on a desolate planet with only a cerebrally-embedded AI to guide you, or realizing that your latest game design is the only thing staving off total global annihilation. So unsheath those earbuds, clench that steering wheel, and buckle up because EPIC is about to take off.This month, we are featuring Silver Wing: On a desert planet in the far future, an old dragon hunter embarks on a desperate journey to save her estranged son. For centuries, the dragons have been sleeping. But in their rest, they provide a crucial energy source necessary to keep the planet Toon Flats habitable. Amphet Dahl is a diviner, gifted with the ability to sense the dragons’ dreams and memories and to the disappointment of her son, Afton, she uses this ability to

Frequently Asked Questions

How long is this episode of AI Unchained?

This episode is 50 minutes long.

When was this AI Unchained episode published?

This episode was published on January 5, 2024.

Can I download this AI Unchained episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!