#79- LoRA and QLoRA.

from Life with AI · host Filipe Lauar

Hey guys, this is the first episode in a series of episodes about PEFT, Parameter Efficient Fine Tuning. In this episode I talk about LoRA and QLoRA, two widely used methods that allowed us to fine tune LLMs way faster and in a single GPU without losing performance. Video sobre QLoRA: ⁠https://www.youtube.com/watch?v=6l8GZDPbFn8⁠ LoRA paper: ⁠https://arxiv.org/pdf/2106.09685.pdf⁠ QLoRA paper: ⁠https://arxiv.org/pdf/2305.14314.pdf⁠ Instagram do podcast: https://www.instagram.com/podcast.lifewithai Linkedin do podcast: https://www.linkedin.com/company/life-with-ai

Episode metadata supplied by the publisher feed · Published Apr 11, 2024

Embed this episode

Attribution link and audio player

Ready to play

#79- LoRA and QLoRA.

0:00 13:45

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Life with AI?

This episode is 13 minutes long.

When was this Life with AI episode published?

This episode was published on April 11, 2024.

Can I download this Life with AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!