Why Speeding Up AI Could Save Lives | Nick Bostrom artwork

Why Speeding Up AI Could Save Lives | Nick Bostrom

MTS

October 8, 2026

Nick Bostrom discusses the optimal timing for superintelligence, whether LLMs exhibit true instrumental convergence, AI consciousness, and why current safety frameworks may be asking the wrong questions. Turn ideas into software people love.

0:00

Nick Bostrom

If we do develop this safely, then human life expectancy could go up hugely. If you imagine people having the same mortality rate as like a 20 year old, our life expectancy would maybe be, you know, 1200, 1400 years or so. On the other hand, if the risk of AI goes down too slow, then you also don't want to wait, because like we are just dying in the meantime, and you lose more expected life years from waiting than you gain from having the research. So it requires a sort of rightly balanced intermediate case to get sort of longer wait periods of many years.

0:37

SPEAKER_2

All right.

0:38

SPEAKER_3

We are back. We are live with Nick Bostrom, who was a professor at Oxford, founding director of the Future of Humanity Institute. He's now founder and principal researcher of the Macro Strategy Research Initiative. You may know him as the author of Superintelligence, of Deep Utopia, of a lot of work that coined or framed the ideas that we take for granted today in the discourse, existential risk, the simulation hypothesis, the vulnerable world hypothesis, so much more. Nick, this has been in the works for a long time, so we're thrilled to have you on. Welcome to MTS.

1:13

Nick Bostrom

I'm happy to be here.

1:15

SPEAKER_2

So where should we start?

1:17

SPEAKER_3

I guess we could start with, what's your opinion on Trump calling AI superintelligence? What are your thoughts on this?

1:25

Nick Bostrom

It's a strange time we're living in. We'll see if it catches on. Traditionally, AI has been the larger the umbrella term, right? You could have a little simple expert system from the 1970s. That would be AI. It's kind of a stretch to use the word superintelligence for all of that.

In my terminology, superintelligence has been this thing further down the road, where you really have machines that radically outperform us in all cognitive domains. But, I mean, you could, I guess, look at some of the current achievements, you know, solving all these math problems and so forth. And, I mean, it's not completely ridiculous to start calling at least some of these performances superhuman and the thing superintelligent.

2:15

SPEAKER_2

Yeah. So I guess, like, what has surprised you about what capabilities have advanced relative to others, you know, in the current state of superintelligence?

2:25

Nick Bostrom

Well, it depends on relative to what expectation stage. So I think if you were looking at the future of AI 15 or 20 years ago, it was not obvious that you would have an extended period of time when we would have systems that could speak, like just talk to humans in ordinary English without sort of immediately after, like just becoming radically superintelligent and leaving us in the dust everywhere. So the sort of emergence of language as a kind of natural affordance of these systems was, I think, somewhat surprising.

I mean, more recently, I don't know how surprising it was. I mean, coding and mathematics are very impressive, but it is also areas where you do have objective feedback that you can gather quickly and at scale. So I guess it's less surprising, but still striking.

3:18

SPEAKER_3

More broadly, how has your thinking on AI and existential risk changed since the advent of LLMs? It seems like this sort of changed the way that a lot of people think about AI.

It's less of like a sort of strong optimizer type thing, and more of a sort of broad, like fuzzy encapsulation of human values. I think RL has pushed the idea of AI a little bit back towards the first few, but not entirely all the way. So what are your thoughts on this broadly?

3:51

Nick Bostrom

Yeah, it'll be interesting to see how it goes, because when the sort of pre-training phase was the dominant chunk of training, they did absorb a lot of human psychology just from reading all this stuff that we have written, and they had these kind of almost human foibles and quirks. That was an early stage where if you gave the AI a little pep talk, like, this question is really important, please try your utmost, so I might lose my job if I don't answer this question. Like, they would actually perform better.

Now, from 20 years ago or something, that would have been like an insane prediction, right? Like, it's not the way computers work, that you need to give them a pep talk to get them to perform. But as you said, now with the increasing dominance of the sort of reinforcement learning post-training, we do seem to get more of the sort of goal, monomaniacal, goal-focused optimization style behavior again. And I think it depends where we go from here. It does look like this more goal-seeking in the reinforcement learning sense dynamics put a big strain on alignment efforts. And so given now that there is increasing awareness of the problem of alignment, you know, maybe that will lead labs to develop techniques to kind of counteract that a little bit. So it will be interesting to see how that shakes out.

Read the other 42 minutes of this episode here.

$15 gets you this episode and 99 more. Credits never expire. After checkout, one link brings you back here to read it.

Not what you expected? Full refund within 14 days.

Thousands of transcripts fetched by people building searchable podcast archives

Fetch transcripts with code

The same credits work from a script or an AI agent. The demo key returns a sample episode in full, no card needed:

request
curl -H "x-api-key: pt_demo" \
  https://spoken.md/transcripts/1000651996090

Markdown with the speakers named, for your notes, your knowledge base, or anything that makes HTTP calls.

From $0.10 per transcript. No subscription. Credits never expire. Prices exclude VAT, added at checkout for EU customers. Not what you expected? Email us within 14 days with 20 or fewer credits used and we refund the pack in full.

Using your own key:

request
curl -H "x-api-key: YOUR_KEY" \
  https://spoken.md/transcripts/1000793937314