just now

LLM Inference Speed (Tech Deep Dive)

First published

10/06/2023

Genres:

technology

culture

philosophy

Listen to this episode

0:00 / 0:00

Summary

In this tech talk, we dive deep into the technical specifics around LLM inference.The big question is: Why are LLMs slow? How can they be faster? And might slow inference affect UX in the next generation of AI-powered software?We jump into:Is fast model inference the real moat for LLM companies?What are the implications of slow model inference on the future of decentralized and edge model inference?As demand rises, what will the latency/throughput tradeoff look like?What innovations on the horizon might massively speed up model inference?

Duration

Parent Podcast

Thinking Machines: AI & Philosophy

View Podcast

Share this episode

Similar Episodes

    Reid Blackman - Ethical Machines: AI & Cyberethics

    Release Date: 03/09/2023

    Authors: Tim Ventura

    Description: Artificial Intelligence learns by example - what happens when it learns the wrong thing? Dr. Reid Blackman discusses implicit bias, privacy issues, and the need for explainable decision-making in black-box systems. Dr. Reid Blackman is the author of “Ethical Machines”, Founder and CEO of Virtue, an AI ethical risk consultancy, volunteer Chief Ethics Officer for the non-profit Government Blockchain Association, and an advisor to the Canadian government on their federal AI regulations. He was also a founding member of EY’s AI Advisory Board and a Senior Advisor to the Deloitte AI Institute. Reid's work, which includes advising and speaking to organizations including AWS, US Bank, the FBI, NASA, and the World Economic Forum, has been profiled by The Wall Street Journal, the BBC, and Forbes. His written work appears in The Harvard Business Review and The New York Times. Prior to founding Virtue, Reid was a professor of philosophy at Colgate University and UNC-Chapel Hill. Reid Blackman's Homepage: https://www.reidblackman.com/ Reid's Podcast: https://www.reidblackman.com/podcast/ Ethical Machines (Purchase Links To Amazon, Barnes & Noble, Bookshop.org) https://www.reidblackman.com/ethical-machines/

    Explicit: No

    How To Teach Artificial Intelligence Morality and Ethics

    Release Date: 04/21/2021

    Description: In today's episode, we have Devin Gonier on the show - a passionate machine learning expert from the U.S., who will take us deep into artificial intelligence morality and ethics. Devin is the CTO of a machine learning company WageUp, has a Masters degree in machine learning, and a double major in philosophy and religion. He argues that the best way to apply philosophy in our modern society is to, in fact, work with artificial intelligence. Is there a way to teach artificial intelligence morality and ethics? What is right or wrong? How can we teach a machine moral and ethics, when in fact philosophers cannot even agree on what is right or wrong? In a Ted Talk at Austin College, he explains how humans learn what is good and bad, and how machines could learn morals the same way as humans. As morality and ethics is such a complex matter, perhaps we should replicate our human way of learning moral behaviour to machines - instead of trying to find one single algorithm that defines moral behaviour. Episode learnings: How we can teach artificial intelligence morality and ethics What is AI safety and how we can keep machines safe for humanity Why philosophy is an increasingly important study subject in a world powered by AI What an AI world built for humanity, not against, could look like Devin Gonier has also written a paper on this topic and is currently starting a blog to share more of his ideas. Visit his work at lastgreatinvention.com.

    Explicit: No

    Will AI outsmart humans? with Dr. Duncan Pritchard of UCI

    Release Date: 02/14/2024

    Description: http://singularitysyndicate.org presents:Can artificial intelligence truly outsmart humans? Philosopher and epistemologist Dr. Duncan Pritchard debates the limits of AI versus human cognition. He shares his skeptical take on whether machines can match human intelligence and consciousness. Pritchard discusses whether creative jobs are under threat as AI systems, machine learning algorithms, neural networks, and predictive chatbots transform society. - How much can AI truly understand concepts like humor, poetry, and art? Pritchard explores AI hype, the possibility of artificial general intelligence, AGI existential threats, robot emotions, and more:- Will automated systems take over the world? - Can capitalism survive technological unemployment and jobs eliminated by thinking machines? - Is universal basic income (UBI) inevitable as predictive algorithms and smart robots beat humans at games like chess and Go? Pritchard explains what makes natural intelligence special, including our open-ended reasoning, capacity for truth, language abilities, and innate curiosity. Discover if machines can ever attain true consciousness and care about accuracy like philosophically-minded humans. Explore automation and creative destruction versus emotional intelligence and the arts in this debate on AI ethics and algorithmic bias.Curious to learn more about the topic? Dr. Pritchard cited "Noam Chomsky's The False Promise of ChatGPT," where in this article, philosopher Noam Chomsky raises concerns about the limitations of artificial intelligence, particularly in the realm of machine learning. The article delves into the moral challenges and implications of machine learning programs in making ethical decisions, including the amorality of AI and the struggle to balance creativity and morally objectionable content. Additionally, it explores the complex and controversial topic of the morality of terraforming Mars, discussing the potential consequences and benefits of such endeavors while highlighting the importance of preserving the natural state of other planets. Chomsky's insights shed light on the ethical and scientific implications of advancements in artificial intelligence, emphasizing the need for careful consideration and oversight of these developments.Here is the link to the article: https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html #philosophy #ethics #ai #agi #aitakeover #consciousness #artificialintelligence #bias #automation

    Explicit: No

    AI Consciousness: Fact or Fiction? with Professor Joseph Dowd

    Release Date: 10/06/2023

    Description: Could machines truly be conscious? Dive into an intriguing discussion with Professor Joseph Dowd as we explore the implications of AI consciousness. Get ready for an intellectual ride! #AIConsciousness #deepdive In this intellectually stimulating podcast, Naja engages in an insightful discussion with Professor Joseph Dowd, an expert in philosophy. The primary focus of the conversation revolves around an intriguing question: Can AI truly be conscious? As an esteemed lecturer and published author in philosophy, Professor Dowd brings unique insights to the table, dissecting this complex issue through the lens of various philosophical perspectives including Aristotelian hylomorphism, medieval ethics, and Eastern philosophies. Their conversation is not merely abstract, as they delve into the practical implications of AI consciousness in our society, questioning the essence of what it means to be human and intelligent in an age of advanced technology. Through engaging storytelling and thought-provoking questions, this podcast offers a fresh perspective on the rapidly evolving intersection of philosophy and artificial intelligence. By the end, listeners will be left with a richer understanding and plenty of food for thought.

    Explicit: No

Similar Podcasts

    Thinking Philosophy

    Release Date: 09/04/2020

    Authors: Australian Catholic University

    Description: Delve into the world of ideas, ethics and deep reflection with philosophers committed to the examined life.

    Explicit: No

    Posts - nicholas carah

    Release Date: 09/23/2020

    Authors: Nicholas Carah

    Description: Thinking about the entanglements between humans and machines that collect, store and process data.

    Explicit: No

    Posts - nicholas carah

    Release Date: 01/05/2022

    Authors: Nicholas Carah

    Description: Thinking about the entanglements between humans and machines that collect, store and process data.

    Explicit: No

    Creative Next: AI Automation at Work

    Release Date: 08/06/2020

    Authors: Creative Next

    Description: Future-proofing creatives from AI automation. We help marketers, designers, engineers, and entrepreneurs prepare to successfully collaborate with machines.

    Explicit: No

    Invisible Machines podcast by UX Magazine

    Release Date: 08/06/2020

    Authors: Invisible Machines

    Description: UX Magazine presents the Invisible Machines podcast.Conversational AI is going everywhere. Join great weekly conversations with experts in a podcast about conversational AI and hyperautomation, covering the intersection of UX, business, technology and design.Robb Wilson and Josh Tyson, authors of Age Of Invisible Machines, the first bestselling book about conversational AI, envisioned the moment we’re in with ChatGPT and the AI revolution. Join weekly as they continue their discussion with leading thinkers and doers.

    Explicit: No

    Harish's Notebook - My notes... Lean, Cybernetics, Quality & Data Science.

    Release Date: 06/04/2021

    Authors: Harish Jose

    Description: This podcast is generated utilizing the Anchor FM's AI. The podcasts are the posts published at my blog https://harishsnotebook.wordpress.com where I talk about Cybernetics, Systems Thinking, Philosophy and Lean. I hope you enjoy my work!

    Explicit: No

    Living in AI world podcast

    Release Date: 08/17/2020

    Authors: Jonathan Seal

    Description: Living in AI world: podcast talking to experts and influencers from different domains about how intelligent machines are reshaping every aspect of our lives.

    Explicit: No

    HumAIn Podcast - Artificial Intelligence, Data Science, Developer Tools, and Technical Education

    Release Date: 09/02/2020

    Authors: David Yakobovitch

    Description: David Yakobovitch explores AI for consumers through fireside conversations with industry thought leaders on HumAIn. From Chief Data Scientists and AI Advisors, to Leaders who advance AI for All, the HumAIn Podcast is the channel to release new AI products, to learn about industry trends, and to bridge the gap between humans and machines in the Fourth Industrial Revolution.

    Explicit: No

    the thinkist

    Release Date: 03/26/2021

    Authors: Drew Mery

    Description: Thinking God's thoughts after Him in theology, philosophy, and science.

    Explicit: No

    Artificial Intelligence

    Release Date: 07/12/2021

    Authors: AItools

    Description: Artificial intelligence is the simulation of human intelligence processes by machines, especially computer systems. Specific applications of AI include expert systems, natural language processing, speech recognition and machine vision.

    Explicit: No

    The Future of Machines

    Release Date: 04/29/2021

    Authors: Pseudo

    Description: An AI-driven podcast that never has a real human speaking, only machines. Support this podcast: https://anchor.fm/tfom/support

    Explicit: No

    The Reasonerverse

    Release Date: 09/16/2021

    Authors: James Loft

    Description: The latest ideas and thinking around automation, AI and business change through new technology.

    Explicit: No