Causality, LLMs & Abstractions || Matej Zečević || Causal Bandits Ep. 000 (2023)

Send us Fan MailSupport the showVideo version of this episode available on YouTubeRecorded on Aug 14, 2023 in Frankfurt, GermanyAre Large Language Models (LLMs) causal? Some researchers have shown that advanced models like GPT-4 can perform very well on certain causal benchmarks. At the same time, from the theoretical point of view it's highly unlikely that these models can learn causal structures. Is it possible that large language models are not causal, but talk causality? In our conversation we explore this question from the point of view of the formalism proposed by Matej and his colleagues in their "Causal Parrots" paper. We also discuss Matej's journey from the dream of becoming a hacker to a successful AI and then causality researcher. Ready to dive in?Links EventsCausality Discussion Group (https://discuss.causality.link/) Eastern European Machine Learning Summer School (https://www.eeml.eu/home) Videos Prof. Moritz Helmstaedter on connectomicsBooks Molak (2023) - Causal Inference & Discovery in Python Pearl & Mackenzie (2019) - The Book of WhyPapers For full list of papers see the episode's description here.Support the showCausal Bandits PodcastCausal AI || Causal Machine Learning || Causal Inference & DiscoveryWeb: https://causalbanditspodcast.comConnect on LinkedIn:   https://www.linkedin.com/in/aleksandermolak/Join Causal Python Weekly: https://causalpython.io  The Causal Book: https://amzn.to/3QhsRz4