The Terrifying Problem Of AI Control - Stuart Russell - #364

**Chris Williamson** (0:00)
Hi friends, welcome back to the show. My guest today is Stuart Russell. He's a Professor of Computer Science at the University of California and an author. Programming machines to do what we want them to is a challenge. The consequences of getting this wrong become very grave if that machine is super intelligent with essentially limitless resources and no regard for humanity's wellbeing. Stuart literally wrote the textbook on artificial intelligence, which is now used in hundreds of countries. So hopefully he's got an answer to perhaps the most important question of this century. Today, expect to learn how AI systems have already manipulated your preferences to make you more predictable, why social media companies genuinely don't know what their own algorithms are doing, why our reliance on machines can be a weakness, Stuart's better solution for giving machines goals and much more. I think the main takeaway from this conversation is that programming computers to do what you actually want is really, really hard. And we don't have the luxury of getting this wrong if the computer that we're trying to program is incredibly intelligent and controlling essentially the entire world. I'm very glad that someone like Stuart is thinking about these questions because he seems to be about as qualified as you can be. But as you'll hear, there are far fewer resources than are needed being dedicated to this area of research. Before we get on to other news, if you haven't already picked up a copy of the Modern Wisdom reading list, 100 books to read before you die, you can go and get yours right now for free by heading to chriswillex.com/books. It's completely free. It took me months to write and thousands of people have already downloaded it. So go and get your copy now chriswillex.com/books. In these other news, this episode is brought to you by Pure Sport CBD. They have just released a brand new product, the Pure Sport Mind and Body Mushroom Blend. It's a powerful invigorating and stimulating blend of six mushrooms that seeks to enhance focus and also aid in relieving stress and anxiety. Mushrooms are one of those supplements that I've really wanted to get into for ages. I heard paul Stamets on Joe Rogan years ago, and he was extolling the virtues of mushrooms for health and cognition and longevity and all sorts of other stuff. But I didn't know where to start. I don't know what I'm supposed to take and what doses and what blend. Pure Sport has taken the guesswork out of this. They've put Lion's Mane and Chagr and Rishi mushrooms and shiitake and cordyceps into one capsule that you just take once per day, and it covers all of your bases. Head to puresportcbd.com/modernwisdom and use the code MW20 to get 20% off everything, all full priced items including their brand new mushroom blend. That's puresportcbd.com/modernwisdom and the code MW20 for 20% off. In other, other news, this episode is brought to you by DW Aligners. You can get the perfect straight smile that you have always dreamed of. 70% cheaper than other Invisible Align methods and you can get it in under 3 months. They have a digital system that means that you can skip regular trips to the dentist. At home impression kits and digital scanners around the UK mean that they can create a fast treatment for a fraction of the price compared to other methods. It's an easier, quicker and cheaper way to get the smile that you've always dreamed of while still receiving all the support and expertise that you would traditionally. Plus, they also offer great finance plans. You even get a treatment coordinator who goes through every step of the way along with you. The Aligners are invisible and unobtrusive. No one can see that you're wearing them. And if you've been thinking, I really want to get my teeth sorted, I'd feel much more confident with a straight smile. This is the place to go. They're half a billion scans deep and counting on their artificial intelligence system and their team of registered dentists will ensure that you're moving forward correctly. Head to dwaligners.co.uk/modernwisdom.
That's dwaligners.co.uk/modernwisdom to get your straight smile 70% cheaper than other invisible aligners. But now it's time for the wise and wonderful Stuart Russell.
Stuart Russell, welcome to the show.

**Stuart Russell** (4:45)
Thank you, nice to be here.

**Chris Williamson** (4:47)
What do King Midas and artificial intelligence have in common?

**Stuart Russell** (4:53)
Good question. So King Midas is famous in two ways, right? So he had the golden touch, so people think of him as kind of a lodestone for getting rich. But the moral of the story with King Midas is he said, I want everything I touch to turn to gold. And he got exactly what he wanted. So the gods granted his wish, and then he finds out that he can't eat because his food turns to gold, and he can't drink because his wine turns to gold, and then his family turns to gold. So he dies in misery and starvation.