Open source LLMs are catching up (News) episode artwork

EPISODE · Dec 11, 2023 · 7 MIN

Open source LLMs are catching up (News)

from Changelog Master Feed

A group of researchers set out to test claims that its open source rivals had achieved parity (or even better) with ChatGPT on certain tasks, Richard Hipp and his team have rewritten SQLite's text-based JSON functions, Ratatui is a Rust crate for cooking up TUIs, Morris Brodersen built a complex app in vanilla JS as a case study & Headscale is Kristoffer Dalby's open source, self-hosted implementation of the Tailscale control server.

NOW PLAYING

Open source LLMs are catching up (News)

0:00 7:26
of MATCHES

TRANSCRIPT · AUTO-GENERATED

What up, nerds? I'm Jared, and this is Changelog News for the week of Monday, December 11th, 2023. Thank you to all of our listeners who left us voicemails for next week's State of the Log episode. Our inbox now runneth over, and we even have BMC cooking up some special beats for the occasion.

That plus Pound Define round 2 coming up this week. Oh boy, we are finishing up 2023 with a bang. Okay, let's get into this week's news. One year after ChatGPT brought a seismic shift in the entire landscape of AI, a group of researchers set out to test claims that its open source rivals had achieved parity or even better on certain tasks.

In the linked paper, they provide an exhaustive overview of the success, surveying all tasks where an open source LLM has claimed to be on par or better than ChatGPT. Their conclusion? Quote, in this survey, we deliver a systematical review on high-performing open source LLMs that surpass or catch up with ChatGPT in various task domains. In addition, we provide insights, analysis, and potential issues of open source LLMs.

We believe that this survey sheds light on promising directions of open source LLMs and will serve to inspire further research and development, helping to close the gap with their paying counterparts. End quote. It's becoming increasingly clear to me that the data models powering future AI rollouts will be commoditized and democratized, thanks to the competitive nature and hard work of both academia and industry. What a relief.

Richardhip and his team have rewritten SQLite's text-based JSON functions using a binary representation, much like Postgres did years ago. This new JSONB, depending on usage patterns, could be several times faster than the original. The technical explainer is, quote, historically, SQLite used an internal binary representation of JSON that involved lots of pointers. This fits well into C programs, but it is difficult to serialize.

The JSONB rewrite changes the internal use binary representation of JSON into a contiguous byte array that can read or be written as an SQLite blob. This allows the internal use representation of JSON to potentially be saved to the database in place of JSON text, eliminating a bunch of overhead. End quote. All legacy functionalities preserved.

The JSON functions that previously only accepted JSON text now accept JSONB binary for the same parameter. This looks like a huge step forward for everyone's favorite and the most widely deployed in the world, SQLite engine. Phenomenal cosmic power! Ratatouille, which may be the best name ever, and you'll find out why soon, is a lightweight library that provides a set of widgets and utilities to build complex Rust terminal user interfaces, or TUIs.

Ratatouille is based on the principle of immediate rendering with intermediate buffers. This means that for each frame, your app must render all widgets that are supposed to be part of the UI. This, in contrast to the retained mode style of rendering where widgets are updated and then automatically redrawn on the next frame. Ratatouille was forged from TUIRS in 2023 in order to continue the project's development.

Its output and TUIs look really cool, but let's face it, I included it here because I love the name Ratatouille. Build your TUIs with Ratatouille. Cook up a TUI with Ratatouille. Something for Yui by Ratatouille.

Okay, stop Jared, just stop. You know what time it is. Sponsor news. If you had a list of commands that your engineering team uses daily, NPM would likely be near the top.

Shouldn't that crucial command be secure? Well, now it can be. Thanks to Socket's safe NPM CLI tool that transparently wraps the NPM command and protects developers from malware, typo squats, install scripts, protestware, telemetry, and more. I was very impressed by the team and tech behind this tool when we first heard about it on JS Party.

If you haven't given Socket's safe NPM a good look, you owe it to yourself to follow the link in your show notes and chapter data and to check it out. Thanks once again to Fros and all our friends at Socket for sponsoring Changelog News. Morris Broderson built a highly interactive, complex application, a clone of the ToDo app called To-Do. That's T-E-U-X-D-E-U-X.

Using vanilla HTML, CSS, and JavaScript, he did it as a case study, attempting to find and stretch the limitations of vanilla web development. Morris says, quote, There's no custom framework invented here. Instead, the case study was designed to discover minimum viable patterns that are truly vanilla. The result is maintainable, albeit verbose, and with considerable duplication.

If anything, the case study validates the value of build steps and frameworks, but also demonstrates that standard web technologies can be used effectively, and there are only a few critical areas where a vanilla approach is clearly inferior. End quote. The code is all open source, but Morris' write-up and his conclusion in particular is so thorough and thoughtful that you might be satisfied just by reading that alone. If you love TailScale's offerings but prefer the maximum privacy and autonomy that only comes by self-hosting everything, check out this project by Christopher Dalby, who works at TailScale, by the way.

Christopher says, quote, Everything in TailScale is open source except the GUI clients for proprietary OSs and the control server. The control server works as an exchange point of WireGuard public keys for the nodes in the TailScale network. It assigns the IP addresses of the clients, creates the boundaries between each user, enables sharing machines between users, and exposes the advertised routes of your nodes. End quote.

Headscale is Christopher's implementation of a self-hosted open source alternative to the TailScale control server. Headscale's goal is to provide self-hosters and hobbyists with an open source server they can use for their projects and labs. It implements a narrow scope, which is a single TailNet, suitable for personal use or a small open source organization. That's the news for now, but also scan the email newsletter for even more stories, such as Ars Technica pitting Google's new Gemini-powered Bard against ChatGPT, Dan Hockenmeyer's proposed hierarchy of needs to use when choosing which startup to work for, and The Verge's coverage of a new low-level internet protocol called L4S.

If you don't get Changelog News in your inbox each Monday, fix that bug at Changelog.com slash news. We have some awesome podcasts coming up this week. Our final All Things Open anthology ships out Wednesday, and we're playing Pound Define again with the same wacky cast of characters plus one on Friday. Have a great week.

Tell your friends about the Changelog if you dig it, and I'll talk to you again real soon.

PodQuesting Dwight J Randolph- WolfShield Media PodQuesting: -By WolfShield Media and Dwight J RandolphJoin us on an exciting journey to master the world of fiction podcasting! At PodQuesting, we document our quest to improve and innovate, sharing valuable insights, strategies, and behind-the-scenes tips along the way. Whether you're an experienced podcaster or just starting your first show, our podcast is your go-to resource for everything podcasting.Discover practical advice, creative techniques, and lessons from our own experiences as we explore the ever-evolving podcasting landscape. Ready to level up your skills and embark on this adventure with us? Tune in and join the quest!Have questions or feedback? Reach out to us at [email protected] and visit our website:WolfShield.Media The PFN Cincinnati Bengals Podcast Pro Football Network The PFN Cincinnati Bengals Podcast is where you can stay up-to-date with the latest news and analysis on the Cincinnati Bengals! Our hosts, industry experts Jay Morrison and Dallas Robinson, provide weekly coverage of all the latest rumors and updates about the Bengals. Don’t forget to follow the show to receive new episodes directly in your podcast feed and leave a rating and review to let us know your thoughts. The 48 Laws of Power by Robert Greene (Full Audiobook) Robert Greene Amoral, cunning, ruthless, and instructive, this multi-million-copy New York Times bestseller is the definitive manual for anyone interested in gaining, observing, or defending against ultimate control – from the author of The Laws of Human Nature.In the book that People magazine proclaimed “beguiling” and “fascinating,” Robert Greene and Joost Elffers have distilled three thousand years of the history of power into 48 essential laws by drawing from the philosophies of Machiavelli, Sun Tzu, and Carl Von Clausewitz and also from the lives of figures ranging from Henry Kissinger to P.T. Barnum.Some laws teach the need for prudence (“Law 1: Never Outshine the Master”), others teach the value of confidence (“Law 28: Enter Action with Boldness”), and many recommend absolute self-preservation (“Law 15: Crush Your Enemy Totally”). Every law, though, has one thing in common: an interest in t Mind Force Radio.com Mind Force Radio.com Natural Strength Night is an informative, humorous, sometimes a little raucous, good-time of myth busting and honest training information from the trenches. We strive to help everyone involved with old school strength training (without steroids) to not make some common training mistakes. Along with great information, you'll hear a fair share of steroid bashing, flamingo sightings, breaking goons, iron game history, and honest drug-free training information from various leaders and strength coaches in the field to help you get real results! If your primary training information comes from reading "Muscle & Fiction" magazine we'll help get you straightened out. If you love high-intensity strength training, dinosaur style training and just like lifting heavy weights ... or loved Jack Lalanne, Sandow, Grimek, Peary Rader's Iron Man magazine, Brad Steiner's articles, Stuart McRobert's Hardgainer, Iron Nation, Osmo Kiiha's The Iron Master, you will love the show.On The Rugged Individual, we

Frequently Asked Questions

How long is this episode of Changelog Master Feed?

This episode is 7 minutes long.

When was this Changelog Master Feed episode published?

This episode was published on December 11, 2023.

What is this episode about?

A group of researchers set out to test claims that its open source rivals had achieved parity (or even better) with ChatGPT on certain tasks, Richard Hipp and his team have rewritten SQLite's text-based JSON functions, Ratatui is a Rust crate for...

Can I download this Changelog Master Feed episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!