Open Source LLMs Are Catching Up  ## Metadata - Author: [[The Changelog: Software Development, Open Source]] - Full Title: Open Source LLMs Are Catching Up - Category: #podcasts - URL: https://share.snipd.com/episode/33c1526b-bb14-4700-87aa-6301e21863b7 ## Document Notes ## Highlights - **Open-Source LLMs Closing the Gap** - Open-source LLMs are catching up to closed-source models like ChatGPT. - Researchers found open-source models perform on par or better in various tasks. Transcript: Jerod Santo Okay, let's get into this week's news. One year after chat, GPT brought a seismic shift in the entire landscape of AI, a group of researchers set out to test claims that its open source rivals had achieved parity or even better On certain tasks. In the linked paper, they provide an exhaustive overview of this success, surveying all tasks where an open source LLM has claimed to be on par or better than chat GPT. Their conclusion? Quote, In this survey, we deliver a systematical review on high performing open source LLMs that surpass or catch up with chat GPT in various task domains. In addition, we provide insights, analysis, and potential issues of open source LLMs. We believe that this survey sheds light on promising directions of open source LLMs and will serve to inspire further research and development, helping to close the gap with their Paying counterparts. End quote. It's becoming increasingly clear to me that the data models powering future AI rollouts will be commoditized and democratized thanks to the competitive nature and hard work of both Academia and industry. ([Time 0:00:34](https://share.snipd.com/snip/7a3cffae-1099-4269-ac5f-51a62dc77628)) - **SQLite's JSON-B Performance Boost** - SQLite's text-based JSON functions have been rewritten using a binary representation (JSON-B). - This change significantly improves performance and efficiency. Transcript: Jerod Santo What a relief. Richard Hipp and his team have rewritten SQLites, text based JSON functions using a binary representation, much like Postgres did years ago. This new JSON be depending on usage patterns could be several times faster than the original. The technical explainer is quote historically, SQLite used an internal binary representation of JSON that involved lots of pointers. This fits well into C programs, but it is difficult to serialize. The JSON be rewrite changes the internal use binary representation of JSON into a contiguous byte array that can read or be written as an SQL blob. This allows the internal use representation of JSON to potentially be saved to the database in place of JSON text, eliminating a bunch of overhead end quote. All legacy functionalities preserved the JSON functions that previously only accepted JSON text now except JSON be binary for the same parameter. ([Time 0:01:45](https://share.snipd.com/snip/9a5f10b6-a2d3-4e6a-ad54-d34f9bb40826)) - **Ratatouille for Rust TUIs** - Ratatouille, a Rust crate, helps build complex terminal user interfaces (TUIs). - It uses immediate rendering with intermediate buffers. Transcript: Jerod Santo Which may be the best name ever and you'll find out why soon, is a lightweight library that provides a set of widgets and utilities to build complex rust, terminal user interfaces or To ease. Ratatouille is based on the principle of immediate rendering with intermediate buffers. This means that for each frame, your app must render all widgets that are supposed to be part of the UI. This in contrast to the retained mode style of rendering where widgets are updated and then automatically redrawn on the next frame. Ratatouille was forged from 2ERS in 2023 in order to continue the project's development. Its outputted to ease look really cool, but let's face it, I included it here because I love the name Ratatouille. ([Time 0:02:54](https://share.snipd.com/snip/e0ca850d-ac03-405a-bd77-3b7c65c73e8c)) - **Vanilla JavaScript Case Study** - Morris Brodersen built a complex to-do app using vanilla JavaScript, HTML, and CSS as a case study. - He explored the limitations of vanilla web development and validated the value of frameworks. Transcript: Jerod Santo Out. Thanks once again to Farras and all our friends at socket for sponsoring Change Log News. Morris Broderson built a highly interactive, complex application, a clone of the tooeyap called todoo. That's T-E-U-X-D-E-U-X. Between vanilla HTML, CSS, and JavaScript, he did it as a case study attempting to find and stretch the limitations of vanilla web development. Morris says, quote, there's no custom framework invented here. Instead, the case study was designed to discover minimum viable patterns that are truly vanilla. The result is maintainable, albeit verbose, and with considerable duplication. If anything, the case study validates the value of build steps and frameworks, but also demonstrates that standard web technologies can be used effectively, and there are only a few Critical areas where a vanilla approach is clearly inferior. ([Time 0:04:27](https://share.snipd.com/snip/8bba5d26-b3f8-4db9-886c-606acb4441dd)) - **Self-Host Tailscale with Headscale** - If you need maximum privacy and autonomy with Tailscale, try Headscale. - Headscale is a self-hosted implementation of the Tailscale control server. Transcript: Jerod Santo End quote. The code is all open source, but Morris's write-up and its conclusion in particular is so thorough and thoughtful that you might be satisfied just by reading that alone. If you love tail scales offerings, but prefer the maximum privacy and autonomy that only comes by self-hosting everything, check out this project by Christopher Dalby, who works At tail scale, by the way. Christopher says, quote, everything in tail scale is open source except the GUI clients for proprietary OS's and the control server. The control server works as an exchange point of WireGuard public keys for the nodes in the tail scale network. It assigns the IP addresses of the clients, creates the boundaries between each user, enables sharing machines between users, and exposes the advertised routes of your nodes. End quote. End quote. Is Christopher's implementation of a self-hosted open source alternative to the tail scale control server? Head scale's goal is to provide self-hosters and hobbyists with an open source server they can use for their projects and labs. ([Time 0:05:22](https://share.snipd.com/snip/b5801bc7-dada-4de8-beaa-26df8ca74b0b))