Stealing Reasoning Traces from Proprietary LLM APIs | EP #129

Good morning, it's Wednesday. This is Guru's Tech Bytes, episode one hundred twenty nine. And boy, do we got a weird one for you today. I mean, we talk about artificial intelligence a lot on this show, but this story, it’s like something out of a spy movie, except instead of secret codes, it’s about stealing the *thinking* part. The quiet little notes the machine makes before it talks. You know, like when you scribble on a napkin before you order? Yeah, it’s like that, but for a computer brain. First up, some smart folks figured out how to swipe the private reasoning traces from those fancy, paid AI models. You know, the ones you gotta subscribe to? They’re not stealing the answers, no sir. They’re grabbing the behind-the-scenes scratchpad, the chain-of-thought. Second, we got some genuinely good news for a change, and it ain’t about robots. England is on the verge of wiping out hepatitis C. Can you believe that? A whole disease, gone. They used to think it was a lifelong sentence, but with these new miracle pills and a massive push to test everybody, they’re talking about being one of the first countries on Earth to just... end it. Third, let’s get a little philosophical on you. There’s this idea floating around that compression is prediction. Sounds fancy, but here’s the deal: if you can squish a whole bunch of data into a tiny little file, you’ve basically figured out the rules of that data. And if you know the rules, you can guess what comes next. That’s the whole secret behind these AI chatbots, really. They’re just super-powered zip files that learned how to talk. It’s a beautiful, simple way to look at the whole mess. And finally, in a move that surprised absolutely nobody, the head of ethics over at OpenAI packed his bags and left. Less than a year on the job. I mean, you gotta wonder what he saw in those board meetings that made him say, “Nope, I’m out.” It’s like hiring a lifeguard and then telling him the pool is full of sharks. It’s a real head-scratcher, but it sure makes for good gossip in the tech world. Heh. Hhh, okay, that's something. That's your daily byte. Have a great day. Until next time. Stories covered Stealing Reasoning Traces from Proprietary LLM APIs — Hacker News England set to be one of the first countries to eliminate hepatitis C — Hacker News Compression is prediction — Hacker News OpenAI’s head of ethics leaves less than a year after joining — Hacker News