Human Experience Is the Bottleneck on AI | Rudolf Laine
MTS
October 16, 2026
Rudolf Laine, member of technical staff at Thinking Machines and author of the No Set Gauge Substack, discusses successionism, the philosophical divides shaping AI alignment (Bentham vs. Mill), and why human ground-truth experience forms an un-automatable bottleneck on moral progress.
Speakers Rudolf Laine
TopicsNews
Rudolf Laine
If it is true that the moral progress, whether humans like things or not, is dependent on that ground truth, the human experience actually matters, then there's a limit to see how much you can automate philosophy. When you're doing morality, at some point, you have to check in on the human ground truth experience, and therefore, the human is actually both on the ultimate sheet of philosophy, and should be.
SPEAKER_2
All right, we are back, we are live in person with Rudolf Laine, who is a member of technical staff at Thinking Machines, but we're not gonna talk about that. He's on in his personal capacity. He's also the author of the No Set Gauge, Substack, co-author of The Intelligence Curse with Luke Drago, who I had on the Theo Jaffe podcast like two years ago at this point, two and a half years ago when the thing came out. So very excited to have you on today to talk about your essay series, Alignment and Succession, which talks about this idea of successionism, which we hear about a lot in our SF circles. The idea that an AI should replace humanity, should or should not replace humanity. What this means is heavily contested, different people have very different visions about this.
But we'll talk about it today. Rudolf, welcome.
Rudolf Laine
Thank you. It's good to be on here.
SPEAKER_2
So tell us, what is successionism for the audience that may not know?
Rudolf Laine
Yeah. So I think there's a wide range of things, but I think basically it's the idea that humans, which are currently the dominant species on Earth, should not continue to do so.
I think maybe there's two ends of the spectrum, or one end of the spectrum, the proper attitude towards humanity is that humanity is a pest. It should be eradicated in favor of some glorious AI mass race that we are going to install in our stead and that will be good and proper. The other end of the spectrum is more like we're going to be like English on the eve of the glorious revolution. We're like, we need some superior being to come and take control and run our government for us. Actually, this time it's not the Dutch that are superior beings, it's the AIs. Maybe humans stay around, but we should hand over control. It's wrong if humans are making decisions because AIs would make better decisions than us, and be more moral about their decisions than we would.
SPEAKER_2
Well, there's a lot baked into that question.
I do think that in successionism discussions, there are a lot of people that get straw manned, where some people who might argue, you know, I believe that AIs should run our economy, for example, because they would do a better job than humans are straw manned into, oh, you're a successionist, you think humanity should be replaced. I think there are very, very few people who think like, current day, present humans should die, in order to be entirely replaced by machines.
Rudolf Laine
Yeah, they definitely exist, but I think there are a few in number. I think there's a bunch of like, I think a bunch of the same kind of like philosophical motivations that lead you to like want to hand off control to the AIs also like kind of in the limits lead you to kind of want to replace humans in general. I think there's some like similarity, kind of like the space of philosophy that you're dealing with there. But yeah, I definitely agree that there's a lot of like, I think, yeah, I think like my starting point in the series are kind of like, not let's try to make fun of the successionists, let's try to like understand like why we have succession issues. So the intellectual question is very interesting that there are people who are very ambivalent about humanity's dominant role on the planet. Like I think it's very interesting because very opposed kind of like your self-interest as a human, for example.
And then, yeah, I think many people have many different views. And I think also these like successionists versus not line cuts across.
Like there's no clean kind of like existing divide that it maps onto. So you find like it's a little bit interesting like, you have a very interesting alliance of people for and against there.
SPEAKER_2
Well, when we talk about humans being the dominant people on the planet, the dominant entities on the planet, I think some might say a typical human doesn't have much power at all. Like the typical human, even in democracies, even in wealthy democracies, even if they themselves have some amount of money, don't have that much power to affect change in the world around them, even in their immediate surroundings, their immediate environment.
Read the other 26 minutes of this episode here.
$15 gets you this episode and 99 more. Credits never expire. After checkout, one link brings you back here to read it.
Not what you expected? Full refund within 14 days.
Thousands of transcripts fetched by people building searchable podcast archives
Fetch transcripts with code
The same credits work from a script or an AI agent. The demo key returns a sample episode in full, no card needed:
curl -H "x-api-key: pt_demo" \
https://spoken.md/transcripts/1000651996090Markdown with the speakers named, for your notes, your knowledge base, or anything that makes HTTP calls.
From $0.10 per transcript. No subscription. Credits never expire. Prices exclude VAT, added at checkout for EU customers. Not what you expected? Email us within 14 days with 20 or fewer credits used and we refund the pack in full.
Using your own key:
curl -H "x-api-key: YOUR_KEY" \
https://spoken.md/transcripts/1000796699832