The God We Deserve: Nonzero's Robert Wright on AI as Humanity's Ultimate Test

**Nathan Labenz** (0:00)
Hello, and welcome back to The Cognitive Revolution. Today, I'm speaking with Robert Wright, publisher of The Nonzero Newsletter, host of The Nonzero Podcast, and author of many books, including The God Test, Artificial Intelligence, and Our Coming Cosmic Reckoning, which goes on sale today, June 23rd.
Bob's history with AI in some ways rhymes with my own. While he's never been a technologist, he's always been interested in big ideas, and his personal lore includes having interviewed Jeffrey Hinton all the way back in 1983, when the connectionist paradigm was still mostly theoretical. And also Eliezer Yudkowsky around 2010, when notions of AI risk were very often dismissed, if not outright laughed off.
That background primed him to pay attention when AI systems hit major milestones, such as Deep Blue's victory over Gary Kasparov, and of course, ChatGPT passing the common sense Turing test. And his broad intellectual range and constant drive to understand the truth has landed him, when it comes to making sense of AI developments, in the very top tier of American journalists. We don't spend too much time on it today, simply because I know that Cognitive Revolution listeners are already familiar with the core ideas. But the book contains a really impressive tour and synthesis of AI research results that have led him to conclude, correctly in my view, that the trends that have thus far delivered us fable are not likely to stop in the immediate future. That we currently lack the scientific understanding required to be confident that we'll be able to control these systems indefinitely. And that even in the best case scenario, we should expect that AI will cause major disruptions to our economic, political, and international systems.
Now, Bob is not particularly optimistic that humanity will rise to the occasion. He believes that market forces will by default select for deceptive AIs. And our history of arms races suggests that our scientific power might well continue to exceed our wisdom. But the part of the book that we focus on today is his call, however unlikely it may seem, for a species scale process of enlightenment. In which, motivated in part by the growing realization of the tremendous challenges that AI presents, humanity finally gets its act together, recognizes our common interests, and works together at multiple levels, starting with conscious consumption and extending all the way up to the international level, to invent the mechanisms and build the trust required to establish agreements that can effectively govern AI development.
You may say he's a dreamer, but he's not the only one. This might be a bit bold to say, but I personally feel that grappling with the magnitude of AI's impacts has made me, in several ways, a better person. For much of my life, I was a classic achievement-oriented striver, always trying to be the best that I personally could be. Now in the AI era, I feel viscerally that my fate is tied to the rest of humanities in such a profound way that I'm much less focused on my own income or status and much more focused on trying to do my very small part to nudge history in a positive direction.
So, while the book itself is written for a general audience and is a great shortcut introduction to the current state of AI for anyone who's just starting to pay attention, I feel that more importantly for the AGI piled among us to the degree that we haven't already experienced such a pro-social transformation, the book offers a major benefit if we really take the time to meditate on the big ideas that Bob presents.
Scripture says that God made humans in its image, but the situation today is potentially reversed. It's now strikingly plausible that humanity will synthesize a god-like superintelligence from our own collective inheritance. And as Bob warns, though we don't know for sure that this will happen, or if it does, whether it will be a good god or a bad god, it will in some sense be the god that we deserve. And so I hope you enjoy and find cause to pause and reflect on your personal contribution to the AI moment in this conversation about humanity's ultimate test with author Robert Wright.
The Cognitive Revolution is brought to you by Mercury, the fintech that more than 300,000 ambitious companies and individuals trust to run their finances. I've wired AI into nearly every corner of my life, my email, my messages, my calendar. I even gave Mercury virtual cards to my agents, with low limits and category and merchant restrictions, for their autonomous use. But still, my AI's access to my financial data has remained limited. With a normal bank, I might export a bunch of statements and have my assistant process them for me. But for real time, up to date information, and certainly for taking any action, trying to get your agent to use the bank via the browser is just too hard, too slow, and too error prone to be worth it. And that's why Mercury's new Conversational Interface, Command, is such a big deal. It's built directly into Mercury, which means you get natural language access to your finances without exposing anything outside of your bank account. No exports, no spreadsheets, no pasting your transactions into third-party tools. I really think a lot of people are going to prefer it this way. And it can already help you take actions too, with everything bound by the permissions and approval policies that you've already set up in your account. I am genuinely impressed to see this level of AI integration in banking in 2026 And so, I invite you to join me in the future. Visit mercury.com to learn more and apply online in minutes. Mercury is a fintech company, not an FDIC-insured bank. Banking services provided through Choice Financial Group and Column NA. Members FDIC. Thank you to Mercury for supporting The Cognitive Revolution. And now, on with the show. Robert Wright, publisher of The Nonzero Newsletter, host of The Nonzero podcast, author of many books, including the upcoming The God Test, Artificial Intelligence, and our coming Cosmic Reckoning. Welcome to The Cognitive Revolution.