LLM Inference Speed (Tech Deep Dive)
First published
10/06/2023
Genres:
technology
culture
philosophy
Listen to this episode
Summary
In this tech talk, we dive deep into the technical specifics around LLM inference.The big question is: Why are LLMs slow? How can they be faster? And might slow inference affect UX in the next generation of AI-powered software?We jump into:Is fast model inference the real moat for LLM companies?What are the implications of slow model inference on the future of decentralized and edge model inference?As demand rises, what will the latency/throughput tradeoff look like?What innovations on the horizon might massively speed up model inference?
Duration
Parent Podcast
Thinking Machines: AI & Philosophy
View PodcastSimilar Episodes
Reid Blackman - Ethical Machines: AI & Cyberethics
Release Date: 03/09/2023
Authors: Tim Ventura
Description: Artificial Intelligence learns by example - what happens when it learns the wrong thing? Dr. Reid Blackman discusses implicit bias, privacy issues, and the need for explainable decision-making in black-box systems. Dr. Reid Blackman is the author of “Ethical Machines”, Founder and CEO of Virtue, an AI ethical risk consultancy, volunteer Chief Ethics Officer for the non-profit Government Blockchain Association, and an advisor to the Canadian government on their federal AI regulations. He was also a founding member of EY’s AI Advisory Board and a Senior Advisor to the Deloitte AI Institute. Reid's work, which includes advising and speaking to organizations including AWS, US Bank, the FBI, NASA, and the World Economic Forum, has been profiled by The Wall Street Journal, the BBC, and Forbes. His written work appears in The Harvard Business Review and The New York Times. Prior to founding Virtue, Reid was a professor of philosophy at Colgate University and UNC-Chapel Hill. Reid Blackman's Homepage: https://www.reidblackman.com/ Reid's Podcast: https://www.reidblackman.com/podcast/ Ethical Machines (Purchase Links To Amazon, Barnes & Noble, Bookshop.org) https://www.reidblackman.com/ethical-machines/
Explicit: No
How To Teach Artificial Intelligence Morality and Ethics
Release Date: 04/21/2021
Description: In today's episode, we have Devin Gonier on the show - a passionate machine learning expert from the U.S., who will take us deep into artificial intelligence morality and ethics. Devin is the CTO of a machine learning company WageUp, has a Masters degree in machine learning, and a double major in philosophy and religion. He argues that the best way to apply philosophy in our modern society is to, in fact, work with artificial intelligence. Is there a way to teach artificial intelligence morality and ethics? What is right or wrong? How can we teach a machine moral and ethics, when in fact philosophers cannot even agree on what is right or wrong? In a Ted Talk at Austin College, he explains how humans learn what is good and bad, and how machines could learn morals the same way as humans. As morality and ethics is such a complex matter, perhaps we should replicate our human way of learning moral behaviour to machines - instead of trying to find one single algorithm that defines moral behaviour. Episode learnings: How we can teach artificial intelligence morality and ethics What is AI safety and how we can keep machines safe for humanity Why philosophy is an increasingly important study subject in a world powered by AI What an AI world built for humanity, not against, could look like Devin Gonier has also written a paper on this topic and is currently starting a blog to share more of his ideas. Visit his work at lastgreatinvention.com.
Explicit: No
Will AI outsmart humans? with Dr. Duncan Pritchard of UCI
Release Date: 02/14/2024
Description: http://singularitysyndicate.org presents:Can artificial intelligence truly outsmart humans? Philosopher and epistemologist Dr. Duncan Pritchard debates the limits of AI versus human cognition. He shares his skeptical take on whether machines can match human intelligence and consciousness. Pritchard discusses whether creative jobs are under threat as AI systems, machine learning algorithms, neural networks, and predictive chatbots transform society. - How much can AI truly understand concepts like humor, poetry, and art? Pritchard explores AI hype, the possibility of artificial general intelligence, AGI existential threats, robot emotions, and more:- Will automated systems take over the world? - Can capitalism survive technological unemployment and jobs eliminated by thinking machines? - Is universal basic income (UBI) inevitable as predictive algorithms and smart robots beat humans at games like chess and Go? Pritchard explains what makes natural intelligence special, including our open-ended reasoning, capacity for truth, language abilities, and innate curiosity. Discover if machines can ever attain true consciousness and care about accuracy like philosophically-minded humans. Explore automation and creative destruction versus emotional intelligence and the arts in this debate on AI ethics and algorithmic bias.Curious to learn more about the topic? Dr. Pritchard cited "Noam Chomsky's The False Promise of ChatGPT," where in this article, philosopher Noam Chomsky raises concerns about the limitations of artificial intelligence, particularly in the realm of machine learning. The article delves into the moral challenges and implications of machine learning programs in making ethical decisions, including the amorality of AI and the struggle to balance creativity and morally objectionable content. Additionally, it explores the complex and controversial topic of the morality of terraforming Mars, discussing the potential consequences and benefits of such endeavors while highlighting the importance of preserving the natural state of other planets. Chomsky's insights shed light on the ethical and scientific implications of advancements in artificial intelligence, emphasizing the need for careful consideration and oversight of these developments.Here is the link to the article: https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html #philosophy #ethics #ai #agi #aitakeover #consciousness #artificialintelligence #bias #automation
Explicit: No
AI Consciousness: Fact or Fiction? with Professor Joseph Dowd
Release Date: 10/06/2023
Description: Could machines truly be conscious? Dive into an intriguing discussion with Professor Joseph Dowd as we explore the implications of AI consciousness. Get ready for an intellectual ride! #AIConsciousness #deepdive In this intellectually stimulating podcast, Naja engages in an insightful discussion with Professor Joseph Dowd, an expert in philosophy. The primary focus of the conversation revolves around an intriguing question: Can AI truly be conscious? As an esteemed lecturer and published author in philosophy, Professor Dowd brings unique insights to the table, dissecting this complex issue through the lens of various philosophical perspectives including Aristotelian hylomorphism, medieval ethics, and Eastern philosophies. Their conversation is not merely abstract, as they delve into the practical implications of AI consciousness in our society, questioning the essence of what it means to be human and intelligent in an age of advanced technology. Through engaging storytelling and thought-provoking questions, this podcast offers a fresh perspective on the rapidly evolving intersection of philosophy and artificial intelligence. By the end, listeners will be left with a richer understanding and plenty of food for thought.
Explicit: No
Similar Podcasts
Thinking Philosophy
Release Date: 09/04/2020
Authors: Australian Catholic University
Description: Delve into the world of ideas, ethics and deep reflection with philosophers committed to the examined life.
Explicit: No
Posts - nicholas carah
Release Date: 09/23/2020
Authors: Nicholas Carah
Description: Thinking about the entanglements between humans and machines that collect, store and process data.
Explicit: No
Posts - nicholas carah
Release Date: 01/05/2022
Authors: Nicholas Carah
Description: Thinking about the entanglements between humans and machines that collect, store and process data.
Explicit: No
Creative Next: AI Automation at Work
Release Date: 08/06/2020
Authors: Creative Next
Description: Future-proofing creatives from AI automation. We help marketers, designers, engineers, and entrepreneurs prepare to successfully collaborate with machines.
Explicit: No
Invisible Machines podcast by UX Magazine
Release Date: 08/06/2020
Authors: Invisible Machines
Description: UX Magazine presents the Invisible Machines podcast.Conversational AI is going everywhere. Join great weekly conversations with experts in a podcast about conversational AI and hyperautomation, covering the intersection of UX, business, technology and design.Robb Wilson and Josh Tyson, authors of Age Of Invisible Machines, the first bestselling book about conversational AI, envisioned the moment we’re in with ChatGPT and the AI revolution. Join weekly as they continue their discussion with leading thinkers and doers.
Explicit: No
Harish's Notebook - My notes... Lean, Cybernetics, Quality & Data Science.
Release Date: 06/04/2021
Authors: Harish Jose
Description: This podcast is generated utilizing the Anchor FM's AI. The podcasts are the posts published at my blog https://harishsnotebook.wordpress.com where I talk about Cybernetics, Systems Thinking, Philosophy and Lean. I hope you enjoy my work!
Explicit: No
Living in AI world podcast
Release Date: 08/17/2020
Authors: Jonathan Seal
Description: Living in AI world: podcast talking to experts and influencers from different domains about how intelligent machines are reshaping every aspect of our lives.
Explicit: No
HumAIn Podcast - Artificial Intelligence, Data Science, Developer Tools, and Technical Education
Release Date: 09/02/2020
Authors: David Yakobovitch
Description: David Yakobovitch explores AI for consumers through fireside conversations with industry thought leaders on HumAIn. From Chief Data Scientists and AI Advisors, to Leaders who advance AI for All, the HumAIn Podcast is the channel to release new AI products, to learn about industry trends, and to bridge the gap between humans and machines in the Fourth Industrial Revolution.
Explicit: No
the thinkist
Release Date: 03/26/2021
Authors: Drew Mery
Description: Thinking God's thoughts after Him in theology, philosophy, and science.
Explicit: No
Artificial Intelligence
Release Date: 07/12/2021
Authors: AItools
Description: Artificial intelligence is the simulation of human intelligence processes by machines, especially computer systems. Specific applications of AI include expert systems, natural language processing, speech recognition and machine vision.
Explicit: No
The Future of Machines
Release Date: 04/29/2021
Authors: Pseudo
Description: An AI-driven podcast that never has a real human speaking, only machines. Support this podcast: https://anchor.fm/tfom/support
Explicit: No
The Reasonerverse
Release Date: 09/16/2021
Authors: James Loft
Description: The latest ideas and thinking around automation, AI and business change through new technology.
Explicit: No