#60 - Como entrar o texto no seu modelo? Entendendo tokenizers.

from Vida com IA · host Filipe Lauar

Fala galera, nesse episódio eu explico como funcionam os tokenizers. Eles basicamente possibilitam a gente entrar texto em algoritmos de NLP como BERT ou GPT. No episódio eu explico 3 tipos de tokenizers, baseado em palavra, baseado em caracteres e baseado e uma representação de sub-palavras. Instagram: https://www.instagram.com/podcast.lifewithai/ Linkedin: https://www.linkedin.com/company/life-with-ai Huuging Face blog sobre tokenizers: https://huggingface.co/docs/transformers/tokenizer_summary

Episode metadata supplied by the publisher feed · Published Dec 1, 2022

Embed this episode

Attribution link and audio player

NOW PLAYING

#60 - Como entrar o texto no seu modelo? Entendendo tokenizers.

0:00 15:11

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Vida com IA?

This episode is 15 minutes long.

When was this Vida com IA episode published?

This episode was published on December 1, 2022.

Can I download this Vida com IA episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!