Skip to content
“Three Subtle Examples of Data Leakage” by abstractapplic episode artwork

Oct 3, 2024 7 min

“Three Subtle Examples of Data Leakage” by abstractapplic

from LessWrong (Curated & Popular)

This is a description of my work on some data science projects, lightly obfuscated and fictionalized to protect the confidentiality of the organizations I handled them for (and also to make it flow better). I focus on the high-level epistemic/mathematical issues, and the lived experience of working on intellectual problems, but gloss over the timelines and implementation details. The Upper Bound One time, I was working for a company which wanted to win some first-place sealed-bid auctions in a market they were thinking of joining, and asked me to model the price-to-beat in those auctions. There was a twist: they were aiming for the low end of the market, and didn't care about lots being sold for more than $1000. "Okay," I told them. "I'll filter out everything with a price above $1000 before building any models or calculating any performance metrics!" They approved of this, and told me [...] --- Outline: (00:27) The Upper Bound (02:58) The Time-Travelling Convention (05:56) The Tobit Problem (06:30) My Takeaways The original text contained 3 footnotes which were omitted from this narration. --- First published: October 1st, 2024 Source: https://www.lesswrong.com/posts/rzyHbLZHuqHq6KM65/three-subtle-examples-of-data-leakage --- Narrated by TYPE III AUDIO.

Episode details come from the podcast's RSS feed.

Embed this episode

This is a description of my work on some data science projects, lightly obfuscated and fictionalized to protect the confidentiality of the organizations I handled them for (and also to make it flow better). I focus on the high-level epistemic/mathematical issues, and the lived experience of working on intellectual problems, but gloss over the timelines and implementation details. The Upper Bound One time, I was working for a company which wanted to win some first-place sealed-bid auctions ...

Ready to play

“Three Subtle Examples of Data Leakage” by abstractapplic

0:00 7:48

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of LessWrong (Curated & Popular)?

This episode is 7 minutes long.

When was this LessWrong (Curated & Popular) episode published?

This episode was published on October 3, 2024.

Can I download this LessWrong (Curated & Popular) episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.