Skip to content
Small Models, Big Questions: When Cheap Fables Get Expensive episode artwork

Oct 24, 2026 21 min

Small Models, Big Questions: When Cheap Fables Get Expensive

from My Weird Prompts

Small language models can generate three million fables at thirteen and a half cents per thousand, but the real question isn't price — it's whether the generator understands what it's making. This episode maps the parameter tiers from three billion upward, separating tasks where small models excel (controlled transformations of verified facts) from tasks where they quietly fail (inventing and labeling expert judgment). Along the way: a maritime intelligence pipeline that cut inference costs 261-fold by letting GPT-4o and o3-mini teach a 7B student, why instruction-following benchmarks reward "constraint hacking," and why a thesaurus is not a curriculum. Key sources: • HuggingFace, SmolLM3 blog, 2025 — https://huggingface.co/blog/smollm3 • model card — https://huggingface.co/Qwen/Qwen2.5-3B-Instruct • model card — https://huggingface.co/google/gemma-3-4b-it Episode 6237 — myweirdprompts.com/n/6237 (permanent short link: myweirdprompts.com/854584) Listen on Android: MWP FM Player — myweirdprompts.com/apk

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Small Models, Big Questions: When Cheap Fables Get Expensive

0:00 21:43

Chapters

  1. 0:00 Intro
  2. 0:24 AI Disclaimer
  3. 0:33 Discussion
  4. 20:14 Send a Prompt
  5. 20:33 Credits
  6. 20:41 Outro

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of My Weird Prompts?

This episode is 21 minutes long.

When was this My Weird Prompts episode published?

This episode was published on October 24, 2026.

Can I download this My Weird Prompts episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.