Conscious Machines, Cyborgs, and Existential Risk

Subscribe and Support: Underthrow.orgThis week’s guest is Jim Rutt — technology veteran, former CEO of Network Solutions, longtime board chairman of the Santa Fe Institute, and chairman emeritus of the California Institute of Machine Consciousness. Jim is also the host of the Jim Rutt Show, one of the sharpest long-form podcasts for serious thinkers.Our conversation today ranges from the hard problem of consciousness to existential AI risk to his vision for redesigning human civilization from the ground up.Consciousness and Conscious MachinesWhat would it mean for an AI to be conscious? Jim offers a functional definition centered on the sensorium—an integrated presentation of multimodal sensory information coupled to memory. He sidesteps the “hard problem” (the philosophical puzzle of how physical processes give rise to subjective experience, like the redness of red) not by dismissing it, but by suggesting that a sufficiently well-executed sensorium with memory might simply dissolve the problem rather than solve it.We may not know until we’ve built one.Hierarchy of RiskJim gives a thorough airing to the AI risk hierarchy by walking us through the full stack: from near-term threats like AI-assisted cyberattacks and bioweapons design, all the way up to artificial superintelligence (ASI).Imagine systems potentially a million times more capable than Isaac Newton — that could render humanity irrelevant or worse. He discusses the geopolitical multipolar trap (the “if we don’t do it, China will” problem), the difficulty of collective action, and his provocative proposal for a priesthood of electricity — human monitors stationed at power facilities who can literally pull the plug if AI systems go rogue.Brains + AIThe brain-computer interface (BCI) path (à la Neuralink) comes up as a possible middle road—creating human-AI chimeras that preserve human lineage in the next generation of superintelligence — but Jim is clear-eyed about the race dynamics: if the pure server-robotics path to ASI takes 8 years and the BCI path takes 30, the former wins by default unless we choose to slow down.Whether humanity can make that choice, given competitive and geopolitical pressures, is very much an open question.Enjoy a rich conversation with one of the most genuinely original thinkers working today. Next week: Jim Rutt returns to talk humane self-organization, a minimum viable metaphysics, and sacralizing complexity. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit underthrow.substack.com/subscribe