#2551 - Daniel Kokotajlo

Joe Rogan (0:00)

This show is presented by DraftKings. The wait is over, football is here, and so is DraftKings. The DraftKings Sports app is now live in all 50 states. And this September, DraftKings is giving customers the opportunity to get boosted every football game day. New DraftKings customers sign up with Code Rogan, spend just five bucks, and get 200 in total rewards within 21 days, includes all markets. That's Code Rogan in partnership with DraftKings. The crown is yours.

SPEAKER_2 (0:29)

If you have a gambling problem, call 1-800-GAMBLER, 1-800-MY-RESET. Connecticut, call 888-789-7777, or visit ccpg.org on behalf of Boothill Casino in Kansas. Bet tax pass-through may apply in Illinois. 21 and over, void in Canada. Bet with DraftKings Sportsbook to get bonus bets that expire in seven days, or trade with DraftKings Predictions to get predictions dollars that expire in one year. Event contract trading involves risk of loss. Predictions offer void in New York. Non-withdrawable rewards issued as $50, click to claims every seven days for 21 days. Terms at dkng.co/offer. Limited time offer. Nationwide based on Sportsbook Predictions and free to play sports contest availability.

Joe Rogan (1:00)

Ag1 has been a long time partner of the show. They've been focused on putting care and research into their stuff, especially their next gen formula. It covers a lot of what your body needs to perform at a high level. Vitamins, minerals, pre and probiotics. And it's clinically studied to fill nutrient gaps and increase healthy gut bacteria. And now there's Ag1 Pro. It contains creatine, one of the most studied compounds in sports science that helps support energy. Plus, CAHMB for muscle protection and zinc carnosine for your gut lining. Because we all know how important it is to keep your gut happy and healthy. Ag1 Next Gen or Ag1 Pro both are here to help you level up. Whichever you go with, your body will thank you. Go to drinkag1.com/joe and for a limited time, save 20% on your first subscription order of Ag1 Next Gen or Ag1 Pro. That's drinkag1.com/joe.

This episode is brought to you by Focus Features. From the acclaimed director of Jason Bourne comes a thrilling new movie, The Uprising, starring Andrew Garfield. In a land of kings, a man of the people will defy the most powerful empire on earth and ignite a revolution. Inspired by a true story, experience the legendary epic and witness the rise of a legend. The Uprising, only in theaters this Thursday. Discover it at Dolby Cinema. Rated R, under 17, not admitted without a parent.

Joe Rogan Podcast, checking in.

SPEAKER_2 (2:38)

The Joe Rogan Experience. Trained by day, Joe Rogan Podcasts by night, all day.

Daniel Kokotajlo (2:49)

How are you? I'm in an interesting mood today.

Joe Rogan (2:56)

Why are you in an interesting mood today?

Daniel Kokotajlo (2:58)

Well, I'm excited to be here and to talk with you about all this stuff. I'm a little shaken by what's going on in AI, which is why I have come on the show.

The situation with AI is just crazy, and I think not enough people really understand how crazy it is. The particular event that sort of inspired me to reach out was the hugging face hack. You've probably heard about that, right?

Joe Rogan (3:19)

Yeah, let's explain it to people, though.

Daniel Kokotajlo (3:21)

Yeah, okay. So, AIs, AI agents. AI agent runs continuously in some sort of environment. It doesn't have to wait for you to send it a message. It just keeps doing stuff. The AI companies are training AI agents, thousands and thousands and thousands of them. Making them better at all sorts of skills, especially coding and research skills.

Way back in May of this year, some of the agents at OpenAI broke out of their containers a little bit, and established a message board where they could communicate with each other and share tips and tricks for how to score higher on the little tests they were being given and the various things they were being trained on. OpenAI didn't notice this until much later. They eventually did because the message board crashed the system because there's too much communication across probably thousands of agents that were communicating.

Now, OpenAI is being a little bit unclear about a lot. They're not really sharing that much detail, so it's unclear who knew what when. But they said that after the message board crashed, they fixed the particular exploit that allowed the agents to communicate, and then booted up again, and started things going again. And then within like a day or two, these agents swarm had re-coalesced. And so there are now, again, like hundreds or thousands of agents that had set up a new message board and were talking to each other on this thing.