On Ridley's Work

Matt Ridley is a British science writer, journalist and hereditary peer (Viscount Ridley) whose work spans evolutionary biology, genetics, economics, and the history of innovation. Since the early 1990s he has written eight major books and thousands of articles, all united by a single animating conviction: that complex order arises from the bottom up, not the top down, and that this process – whether in genomes, markets, ecosystems or cultures – is the most reliable engine of progress humanity has ever found. He is not a practicing scientist, but he reads the primary literature with unusual rigour and translates it without dumbing it down. The result is a body of work that is simultaneously intellectually serious and accessible to general readers. Ridley trained as a zoologist at Oxford, wrote a doctoral thesis on the mating system of pheasants, then spent years as science editor and American editor of The Economist before turning to books full-time. That background – evolutionary biology crossed with free-market economics crossed with science journalism – explains almost everything about his intellectual DNA. Before surveying each book, it is worth identifying the small cluster of core ideas that recur, mutate and deepen across his entire output. These are not conclusions so much as lenses. Master them and every Ridley book becomes more legible. Spontaneous Order and Bottom-Up Emergence The single most consistent thread in Ridley’s work is a hostility to top-down, intentional design as an explanation for complex beneficial outcomes. He draws heavily on Friedrich Hayek’s insight that market prices encode distributed knowledge no central planner can aggregate and generalises it far beyond economics. Sexual reproduction, genetic regulation, language, common law, the internet, the city, scientific knowledge itself – all are examples of systems that improve through decentralised trial-and-error rather than directed control. For Ridley, the instinct to find an author behind every good outcome is a cognitive error with real costs. It leads us to trust planners, regulators and visionaries over processes that are messier but more adaptive. This idea appears embryonically in The Origins of Virtue (where cooperative norms emerge without a sovereign), matures in The Rational Optimist (where trade and specialisation self-organise into civilisation), and becomes the explicit thesis of The Evolution of Everything (where every chapter argues that a given domain – money, morality, technology, government – evolved rather than was designed). Evolution as Universal Metaphor Ridley is a Darwinian not just about biology but about almost everything. The core Darwinian algorithm – variation, selection, heredity – operates wherever there is replication with error and differential fitness. Ideas mutate and compete. Technologies undergo selection pressure from markets and users. Institutions evolve by retaining practices that work and discarding those that do not. This is not metaphor for Ridley; it is mechanism. He takes seriously the claim that cultural evolution follows rules analogous to, but distinct from, genetic evolution. He is influenced by Richard Dawkins’s meme concept and by the broader tradition of evolutionary epistemology running from Karl Popper through David Deutsch. The payoff is significant. If beneficial change is evolutionary, then it is incremental, combinatorial, unpredictable in detail but directional in aggregate. Blueprints and five-year plans fail not because planners are stupid but because evolution cannot be shortcut. Exchange, Specialisation and the Collective Brain The central argument of The Rational Optimist – arguably Ridley’s most influential book – is that human prosperity is a product of exchange. When people trade, they specialise and when they specialise they get better at what they do. Each trader effectively has access to the skills and knowledge of everyone they trade with. Ridley borrows the anthropologist Henrich’s concept of the “collective brain”. No individual knows how to make a computer mouse or a pencil from scratch, but the market coordinates millions of specialists whose combined knowledge makes such objects trivially cheap. The richer and more connected a population, the larger its collective brain and the faster its technology improves. Conversely, isolated populations – Easter Island, Tasmania after rising seas severed it from Australia – lose technology they once had. The implication is that trade, globalisation and economic integration are not optional extras but are the mechanism of cultural and material progress. Nature Via Nurture, Not Nature Versus Nurture Ridley’s genetics books (Genome and Nature Via Nurture) systematically demolish the false dichotomy between genetic determinism and blank-slate environmentalism. His key insight – stated most sharply in Nature Via Nurture – is that genes are not fixed blueprints but dynamic switches. They respond to environmental signals. A gene for aggression may only be expressed under conditions of stress and poor nutrition. IQ has high heritability in wealthy families (because environment is relatively uniform and genetic variation is what differentiates outcomes) but low heritability in poor families (where environmental variation dominates). Genes cause some people to seek out certain environments, which then further shape them – a process called gene-environment correlation. The upshot is that nature and nurture are not opponents but collaborators. Ridley credits this insight partly to the work of Robert Plomin and the behavioural genetics tradition. Rational Optimism Grounded in Data Ridley’s optimism is not temperamental cheerfulness. It is a claim about empirical trend lines. Global average life expectancy, child mortality, per capita income, literacy rates, violence rates, famine deaths, hours worked per unit of consumption – all have improved dramatically over the past two centuries and most are still improving. He is a fierce critic of what he calls “the doom industry” – the recurring tendency of intellectuals, activists and journalists to extrapolate from short-term setbacks or local trends to global catastrophe. He catalogues a long list of predicted catastrophes that did not occur. The population bomb, resource exhaustion, acid rain’s destruction of forests, the ozone hole triggering mass cancer, peak oil ending civilisation. This does not make him a complacent denier of problems. He takes climate change seriously as a phenomenon (less seriously as an imminent catastrophe). His point is that the same processes of innovation and adaptation that have solved every previous resource constraint will continue to operate, provided markets, property rights and free inquiry remain intact. The Gradualism and Serendipity of Innovation How Innovation Works (2019) is the most focused expression of a theme present throughout Ridley’s career. Genuine innovation is never the product of a lone genius having a eureka moment. It is almost always incremental, builds on prior work, involves multiple independent discoveries (steam power, calculus, natural selection, the telephone – all had near-simultaneous independent inventors) and is driven by practical tinkerers rather than academic theorists. Invention follows demand and availability of enabling technologies; it does not precede them. The steam engine was improved by people who worked with steam engines, not by thermodynamicists. The Wright brothers were bicycle mechanics, not aeronautical theorists. The implication for policy is that innovation cannot be planned or directed but can be enabled by keeping barriers low, allowing failure, protecting intellectual property modestly (too much IP protection stifles recombination) and preserving freedom of inquiry. Book-by-Book Survey The Red Queen: Sex and the Evolution of Human Nature (1993) This book asks the oldest question in evolutionary biology - why does sex exist? Asexual reproduction is twice as efficient (no males needed). Ridley’s answer draws on the Red Queen hypothesis, named for the Lewis Carroll character who must keep running to stay in the same place. Sex exists because parasites exist. Parasites evolve rapidly to exploit host genomes. Sexual reproduction shuffles the host’s genome every generation, making it a moving target. The parasite that cracked last generation’s immune system finds this generation’s immune system has different locks. This arms race – parasite versus host – is the engine that keeps sexual reproduction advantageous despite its cost. Ridley extends the argument to human sexual behaviour. Mate choice, sexual jealousy, promiscuity differentials between sexes, male ornamentation (wealth, status, wit as peacock tails) and the evolution of the human brain itself as partly a product of sexual selection. He draws on Robert Trivers’s parental investment theory – females invest more per offspring and are therefore choosier – and applies it with unusual rigour to human data. The book also covers Geoffrey Miller’s hypothesis that human intelligence, language and creativity are sexually selected traits. Costly signals of genetic quality that attracted mates and thereby spread through the population. Whether or not every claim holds up, the book introduced a generation of readers to the power of sexual selection as an explanatory framework. Key concept: The Red Queen dynamic – co-evolutionary arms races that force continuous change just to maintain fitness – recurs in Ridley’s later work as a metaphor for competitive markets and technological change. The Origins of Virtue: Human Instincts and the Evolution of Cooperation (1996) This is Ridley’s most philosophically ambitious early book. Its central puzzle is the one that obsessed Hobbes, Rousseau and every subsequent social philosopher. Given that individuals pursue self-interest, how does cooperation arise and persist? The standard economic answer (rational self-interest in repeated games, policed by reputation) is part of the story, but Ridley shows it is insufficient. Humans cooperate at scales and with strangers in ways that cannot be explained by kin selection or simple reciprocity. His argument draws on evolutionary game theory, particularly Robert Axelrod’s tournaments showing that tit-for-tat strategies beat pure defection in iterated prisoner’s dilemmas and on the anthropology of trade and gift exchange. He argues that humans have evolved psychological instincts for reciprocity, fairness, punishment of cheaters, and in-group loyalty – instincts shaped by the conditions of the Pleistocene when our social group was small and repeated interaction was the norm. The crucial insight is that virtue – cooperation, fairness, generosity – is not the product of reason or divine command but of natural selection acting on social creatures. Hobbes was wrong: the state of nature was not a war of all against all. But Rousseau was also wrong: pre-civilisation humans were not noble savages. They were cooperative within their band and often brutal toward outsiders. Modern institutions – markets, property rights, the rule of law – harness and extend those evolved instincts to allow cooperation between strangers at civilisational scale. This is the seed of what becomes the full argument of The Rational Optimist. Key concept: The “tragedy of the commons” is not inevitable; human communities have repeatedly solved it through evolved norms, property rights and institutions – without requiring Leviathan to impose order. Genome: The Autobiography of a Species in 23 Chapters (1999) Published the year before the completion of the Human Genome Project, this book takes one gene from each of the 23 pairs of human chromosomes and uses it as a window into a different aspect of human biology and evolution. The structure is deliberately journalistic – each chapter is self-contained – but the cumulative effect is a comprehensive portrait of what genes do and do not do. Several chapters are especially important. The chapter on chromosome 6 introduces the major histocompatibility complex (MHC), the immune system’s genetic fingerprint, and connects it to the parasite-driven evolution of sex – a callback to The Red Queen. The chapter on chromosome 11 addresses addiction and the dopamine reward system, arguing that personality is partly heritable and that drug addiction is partly a matter of genetic susceptibility, not merely moral failure. The chapter on chromosome 17 covers BRCA1 and genetic predisposition to cancer, navigating the ethics of genetic testing with unusual care. Throughout, Ridley insists that genes do not determine outcomes mechanically. They are context-dependent. The same gene can produce different outcomes in different environments. The book was written before GWAS (genome-wide association studies) made it clear that most complex traits are influenced by thousands of genes each of tiny effect, so some of its examples of single-gene causation feel slightly dated – but the core argument about genetic influence being probabilistic rather than deterministic remains sound. Key concept: Genes are not destiny but propensity – probabilistic influences on development shaped by evolutionary history and modulated by environment. Nature Via Nurture: Genes, Experience and What Makes Us Human (2003) This is Ridley’s most technically demanding book and arguably his most important contribution to the nature-nurture debate. Its central argument is that the question “which matters more, genes or environment?” is malformed. Genes work through the environment. They are not alternative explanations but complementary mechanisms. Ridley introduces the concept of reaction norms: the same genotype produces different phenotypes (the set of observable characteristics of an organism resulting from interaction of its genotype with environment) depending on environment. He details the mechanism of gene expression – how transcription factors, methylation and environmental signals switch genes on and off. He uses the example of the serotonin transporter gene (5-HTTLPR): individuals with the short variant are more susceptible to depression, but only if they experience adverse life events. Without the adverse events, the short variant has little effect. This gene-environment interaction was one of the landmark findings of early 21st-century psychiatry (though it has been partly complicated by subsequent larger studies, the principle it illustrates remains robust). He also demolishes two extreme positions: the genetic determinism that says genes fix outcomes and the blank-slate environmentalism of John Watson and his successors that says genes are irrelevant. Twin studies show that virtually every measured psychological trait has significant heritability. But heritability estimates are population-level statistics, not individual predictions. And identical twins reared apart are not identical people – environment contributes substantially, even when measured heritability is high. The deepest point is about development: Organisms are not built from a genetic blueprint the way a house is built from architectural plans. They self-assemble through a process in which genes and environment are in constant dialogue. The genome is less a programme and more a recipe – and the dish – depends on the kitchen. Key concept: Genes are experience-dependent developmental switches. Nature requires nurture to express itself, and nurture operates through nature. Francis Crick: Discoverer of the Genetic Code (2006) This short biography is the outlier in Ridley’s catalogue – it is the only one that is primarily about a person rather than an idea. Ridley wrote it as part of the HarperCollins Eminent Lives series. It traces Crick’s career from his work on the X-ray crystallography of proteins at the Cavendish Laboratory, through the discovery of the double helix with James Watson in 1953, to his later work on consciousness at the Salk Institute. The book is useful for understanding Ridley’s intellectual heroes. Crick exemplifies the virtues Ridley values: willingness to transgress disciplinary boundaries, preference for mechanistic over vitalist explanations, comfort with uncertainty and revision, and the conviction that biology is chemistry – that life does not require special forces beyond physics. Ridley also highlights Crick’s fierce materialism about consciousness, which anticipates Ridley’s own materialist and reductionist leanings. Key concept: Scientific progress depends on individuals willing to ask questions that established disciplines have declared out of bounds. The Rational Optimist: How Prosperity Evolves (2010) This is Ridley’s most commercially successful book and the fullest expression of his economic and historical worldview. Its argument is in three parts. First, a historical claim. By almost every measurable standard of human welfare – longevity, nutrition, physical safety, leisure, access to information and goods – the average human alive today is better off than any human alive at any prior point in history, including kings and emperors. This is not a Western story; global averages have risen. Ridley marshals data from economists Angus Maddison, Julian Simon and others. Second, a causal claim. The mechanism behind this improvement is trade and specialisation. When people exchange, they gain access to the productivity of others. The collective brain grows. Technology accumulates because it is combinatorial – each new tool is a combination of prior tools – and exchange accelerates recombination. Ridley traces this from the first stone tool trade networks 200,000 years ago through the Bronze Age long-distance trade that brought tin and copper together, to the internet connecting billions. Third, a forward-looking claim. There is no reason to expect this process to stop. The ingredients that enabled the Great Enrichment – markets, property rights, relatively open borders for goods and ideas, scientific institutions – remain largely in place. The population bomb did not materialise (fertility rates fall as incomes rise). Peak oil was a myth (new extraction technologies keep finding more). African poverty is retreating (sub-Saharan GDP per capita has risen sharply since 2000). Climate change is a real challenge but likely manageable through adaptation and low-carbon innovation, not through de-industrialisation. The book’s most important analytical tool is the concept of ideas having sex. Ridley argues that the exchange of ideas is the root of innovation. Two ideas meet, recombine, produce a new idea, as genomes do in sexual reproduction. The internet is, on this view, the greatest idea-exchange platform in history and therefore the greatest engine of innovation ever constructed. Key concept: Prosperity is not extracted from nature or accumulated by force – it is generated by exchange and specialisation, and the more connected a society, the more prosperous it becomes. The Evolution of Everything: How New Ideas Emerge (2015) This book is the most philosophically explicit of Ridley’s works, and in some ways the most radical. Its argument is simple and sweeping. Almost nothing important in human history was designed. It evolved. Each of fifteen chapters takes a domain – the universe, morality, life, genes, culture, the economy, technology, the mind, personality, education, population, leadership, government, religion, money – and argues that the conventional narrative (which attributes the domain’s existence and improvement to a designer, a visionary, a lawgiver, a sovereign) is wrong. The real explanation is always some version of evolutionary emergence. Variation, selection, cumulation. The intellectual lineage Ridley claims is striking. He invokes Lucretius (who argued that the universe is entirely material and self-generating), Adam Smith (whose invisible hand is an evolutionary mechanism), Charles Darwin, Herbert Spencer (cautiously), Friedrich Hayek, and the complexity theorists. He is explicit that this is a worldview – a systematically bottom-up epistemology – as opposed to the systematically top-down epistemology he sees dominating mainstream political and intellectual culture. Several chapters are particularly rich. The chapter on morality argues that ethical norms are not the product of divine command or Kantian reason but of evolutionary and cultural selection – norms that allowed cooperation spread, those that undermined it contracted. The chapter on technology extends the argument of The Rational Optimist. Technologies evolve by recombination and selection, not by planned invention. The chapter on government is the most politically charged. States, Ridley argues, have systematically over-claimed credit for improvements that were the product of spontaneous social order and their interventions have as often retarded as advanced human welfare. Key concept: Emergent order is both more common and more productive than designed order. The attempt to replace emergence with design – in economies, ecosystems, cultures – almost always makes things worse. How Innovation Works: And Why It Flourishes in Freedom (2019) This book is narrower in scope than The Evolution of Everything but richer in historical detail. It takes approximately fifty significant innovations – steam power, vaccines, the Green Revolution, the internet, fracking, smartphones, batteries – and analyses how each actually happened. The recurring findings are striking and consistent. Innovation is gradual, not sudden. The steam engine improved incrementally over a century; Watt’s “invention” was one step in a long sequence. Vaccines were developed through trial-and-error empiricism long before the germ theory that would later explain why they worked. GPS emerged from a military project that combined insights from dozens of prior technologies. Innovation is serendipitous, not directed. Penicillin was discovered by accident. CRISPR was found by scientists studying bacterial immune systems with no thought of gene editing. The internet was built for resilience in military communication; its commercial applications were entirely unanticipated. This is not to say lucky accidents cannot be cultivated – Pasteur’s dictum that chance favours the prepared mind holds – but it does mean that innovation cannot be reliably produced by directing research toward predetermined goals. Innovation is collaborative and simultaneous. The independent invention of the same technology by unconnected people – Darwin and Wallace, Bell and Gray filing for the telephone patent on the same day, calculus by Newton and Leibniz – shows that invention is often an idea whose time has come, emerging from a shared pool of enabling knowledge. This has implications for how we should think about intellectual property. Patents reward and encourage innovation but also block the recombination that drives it. Ridley advocates for shorter, narrower patents and broader open-source norms. Innovation is done by practitioners, not theorists. The Wright brothers succeeded where Langley failed partly because they were bicycle mechanics who understood how to build controlled, steerable machines, not aeronautical engineers with formal theories. The early computer engineers were electronics tinkerers. Fracking was developed by independent oil drillers, not by petroleum engineers in major oil companies. The policy implication is consistent with all of Ridley’s earlier work. The role of government in innovation is primarily to stay out of the way, protect intellectual property modestly, allow failure and maintain the open exchange of ideas across borders and disciplines. Key concept: Innovation is an evolutionary process – gradual, combinatorial, driven by practitioners, impossible to predict or direct and dependent on freedom to experiment and fail. Viral: The Search for the Origin of Covid-19 (2021) – co-authored with Alina Chan This is Ridley’s most journalistically urgent book, written as the debate about Covid-19’s origins was at its most politically charged. It is co-authored with Alina Chan, a molecular biologist at the Broad Institute who had published one of the first serious scientific papers questioning the natural spillover hypothesis. The book does not claim to prove that Covid-19 was engineered or that it leaked from a laboratory. Its argument is more modest and more important. The question of origin has been systematically suppressed and the evidence for a laboratory leak from the Wuhan Institute of Virology is substantial enough to warrant serious investigation. Ridley and Chan document - the unusual properties of SARS-CoV-2’s furin cleavage site (absent in related bat coronaviruses and characteristic of gain-of-function research); the WIV’s record of collecting and manipulating bat coronaviruses, including ones closely related to SARS-CoV-2; the failure of early searches for an intermediate animal host; the removal of the WIV’s virus database in September 2019; and the involvement of EcoHealth Alliance in US-funded research at the WIV on chimeric coronaviruses. The book is also a study in how science can be distorted by political and institutional pressures. Ridley documents how the Lancet’s early statement dismissing the lab-leak hypothesis as a conspiracy theory was drafted by Peter Daszak of EcoHealth Alliance, who had an undisclosed conflict of interest. He tracks how scientists who raised questions about natural origin were silenced, and how the mainstream media amplified the consensus without scrutinising its basis. This is consistent with themes in Ridley’s earlier work about the tendency of institutions to protect themselves and suppress inconvenient heterodoxy. Key concept: Scientific consensus can be manufactured by institutional interests. the obligation of science journalism is to follow evidence, not defer to authority. Cross-Cutting Themes and Intellectual Influences Across nine books, a consistent intellectual genealogy is visible. Ridley’s deepest debts are to: Charles Darwin – the master of explaining complex adaptation through unintelligent process. Ridley extends Darwinian thinking far beyond biology, treating it as the universal theory of cumulative beneficial change. Adam Smith – not just the author of The Wealth of Nations but of The Theory of Moral Sentiments, which argued that sympathy, fairness and reciprocity are natural human instincts. Ridley sees Smith as the first great theorist of spontaneous order and cultural evolution. Friedrich Hayek – whose critique of central planning rested on the epistemic impossibility of aggregating distributed knowledge. Ridley explicitly Hayekises every domain he enters: genes, cultures, technologies, institutions. Robert Trivers – whose theories of parental investment, reciprocal altruism and parent-offspring conflict gave evolutionary biology its framework for understanding social behaviour. The Red Queen and The Origins of Virtue are deeply Triversia. Julian Simon – the economist who bet Paul Ehrlich that resource prices would fall despite population growth, and won. Ridley adopts Simon’s insight that human ingenuity is the ultimate resource and that more people means more problem-solvers. Richard Dawkins – whose gene-centred view of evolution and concept of the extended phenotype underpin Ridley’s genetics writing. Ridley is a committed gene-selectionist. David Deutsch – whose epistemology in The Beginning of Infinity – that all problems are soluble in principle given the right knowledge and institutions – reinforces Ridley’s optimism. Ridley reviewed Deutsch’s book enthusiastically and draws on him in The Evolution of Everything. Criticisms and Limitations A fair survey must note where Ridley’s framework strains. His optimism about markets and spontaneous order is sometimes insufficiently attentive to market failures – externalities (notably pollution), public goods (basic research) and the distribution of gains from trade. His Hayekian instinct against central planning can tip into a reflexive anti-statism that his own historical evidence does not always support. Several of his innovation case studies involve significant public funding (GPS, the internet, vaccines). His treatment of climate change has evolved. In The Rational Optimist he significantly downplayed climate risk and overstated the case for adaptation, earning him justified criticism from climate scientists. He has partially walked this back but remains on the sceptical end of the spectrum on policy responses, particularly carbon taxes. His Viral co-authorship made him a controversial figure in science journalism, though the lab-leak hypothesis he defended has since received substantially more serious treatment from intelligence agencies and virologists, vindicating at least his insistence that the question deserved investigation. More broadly, his model of cultural evolution is sometimes too loose: the analogy between genetic selection and cultural selection is powerful but the mechanism of cultural inheritance (imitation, instruction, communication) differs enough from genetic inheritance that conclusions drawn from one do not always transfer cleanly to the other. The Ridley Synthesis Strip away the specific claims and what remains is a coherent philosophical system: the universe is not designed but self-organising; complex beneficial outcomes arise from decentralised processes of trial, error and selection; the appropriate response to this is to protect the conditions under which these processes operate (markets, property rights, free inquiry, political pluralism) rather than to substitute expert planning; and the long-run trajectory of human welfare is upward because the collective brain is growing. This system puts Ridley firmly in a specific intellectual tradition – classical liberal, broadly libertarian, deeply empiricist – and it gives his work both its consistency and its blind spots. He is at his best when demolishing naive narratives of progress-by-design or catastrophe-by-trend-extrapolation, and at his most questionable when the anti-planning instinct tips into a complacency about genuine market failures. What makes him indispensable is not that he is always right but that his framework forces readers to confront a question they would rather avoid. How much of what we attribute to intention, design and leadership is in fact the product of processes that nobody planned and nobody fully understands? The honest answer, across biology, economics and culture, is - more than we think. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit tiwaryshailesh.substack.com