What does a Foundational Model of Earth look like? Clay Foundation: Bruno Sanchez-Andrade Nuño - MBM#67

Bruno Sanchez is the Executive Director of the Clay Foundation, which just released their v1 of a “Foundational Model of Earth”. We talk about what that means, building open source & non profits and can’t help but draw parallels to the not-so-open anymore OpenAI. Previously Bruno was the Program Director of the Microsoft Planetary ComputerSponsor: OpenCageUse OpenCage for your geocoding needs with their APIGeomobShownotesNote: Links to books are Amazon Affiliate links. I earn a small commission if you buy any of these books.ClayGithub repoWebsiteMy previous interview with BrunoBook & Podcast recommendationA Thousand Brains by Jeff Hawkins (Affiliate Link)Bad Therapy by Abigael Shrier (Affiliate Link)Timestamps(00:00) - Intro(01:59) - Sponsor: OpenCage(03:39) - What is a Foundational Model?(08:45) - Foundational Task(11:00) - Embeddings, and why they matter(13:49) - Comparing to compression algorithms(16:57) - What do embeddings enable?(19:50) - Finding the Relationship between data(24:16) - Implementation of monitoring all the data - I believe this is where you're going with the question(25:44) - Implementation details(27:52) - Validating a foundational model(33:49) - Earth is a "limited problem"(42:47) - Funding as a non-profit(47:53) - Raising enough philanthropic funding(53:02) - A Litmus test for open projects(56:26) - Future predictions(58:01) - Transparency/privacy(01:00:53) - Commercial data(01:03:36) - Openstreetmap(01:05:49) - Updating foundational models(01:12:17) - Clay model v2?(01:13:43) - Dataset to embedding size comparison(01:14:41) - Model v2 - continued(01:16:45) - Difference working at a non-profit vs a corp(01:20:27) - Book & Podcast recommendation(01:24:01) - Support the podcast on Patreon!Support the podcast on PatreonMy TwitterPodcast TwitterRead Previous Issues of the NewsletterEdited by Peter XiongFind more of his work