#79- LoRA and QLoRA.

An episode of the Life with AI podcast, hosted by Filipe Lauar, titled "#79- LoRA and QLoRA." was published on April 11, 2024 and runs 13 minutes.

April 11, 2024 ·13m · Life with AI

0:00 / 0:00

Summary

Hey guys, this is the first episode in a series of episodes about PEFT, Parameter Efficient Fine Tuning. In this episode I talk about LoRA and QLoRA, two widely used methods that allowed us to fine tune LLMs way faster and in a single GPU without losing performance. Video sobre QLoRA: ⁠https://www.youtube.com/watch?v=6l8GZDPbFn8⁠ LoRA paper: ⁠https://arxiv.org/pdf/2106.09685.pdf⁠ QLoRA paper: ⁠https://arxiv.org/pdf/2305.14314.pdf⁠ Instagram do podcast: https://www.instagram.com/podcast.lifewithai Linkedin do podcast: https://www.linkedin.com/company/life-with-ai

Episode Description

Hey guys, this is the first episode in a series of episodes about PEFT, Parameter Efficient Fine Tuning. In this episode I talk about LoRA and QLoRA, two widely used methods that allowed us to fine tune LLMs way faster and in a single GPU without losing performance.

Video sobre QLoRA: ⁠https://www.youtube.com/watch?v=6l8GZDPbFn8⁠

LoRA paper: ⁠https://arxiv.org/pdf/2106.09685.pdf⁠

QLoRA paper: ⁠https://arxiv.org/pdf/2305.14314.pdf⁠

Instagram do podcast: https://www.instagram.com/podcast.lifewithai

Linkedin do podcast: https://www.linkedin.com/company/life-with-ai

Share this episode

Similar Episodes

New Season, Same God

Jan 15, 2025 ·15m

Standing On Business

Jan 15, 2025 ·18m

I’m Tired Of This Ship”

Dec 8, 2023 ·20m

Episode 26 - community energy & shared ownership

Oct 25, 2023 ·18m

Somebody or Nobody

Oct 21, 2023 ·19m

It’s My Mentality

Sep 16, 2023 ·18m

Similar Podcasts

Life with Rev. Q Quinton Steverson Daily conversations filled with inspirations, insightful thought and in depth prospectives aimed to motivate and challenge you in this journey called life. Ireland Creates with Aisling O' Rourke Aisling O' Rourke Ireland Creates with Aisling O' Rourke is a podcast about Ireland's storytellers. The story behind storytelling. In each episode, Aisling speaks with a different creative about their life, creative practice and what storytelling means to them. Ireland Creates has featured Writers, Photographers, Musicians and Filmmakers to name just a few. If you would like to get involved please check out www.irelandcreates.com or email Aisling on [email protected] Leanne Wood Podcast Leanne Wood With more than twenty five years experience as a political activist on the Welsh left in various roles, including the leadership of Plaid Cymru and Member of the Senedd for the Rhondda, I am now seeking to contribute to political life with a podcast.This new platform aims to give voice to those people and issues we don’t hear enough from or about in the mainstream media. Our politics needs a different conversation. I hope that this podcast will help with that. Confession Session With Life Coach Francis Camia FRANCIS CAMIA This podcast focuses on life's confessions and discussions that will hopefully make an impact to everyone and lead to a better transformation of themselves. We will be talking about purpose, relationships and anything under the sun. It also aims to shed some hope and positivity to all the listeners. On a personal note, you may also send a message or if you want to have a personal catch up or a collaboration. Let's talk!

URL copied to clipboard!