Le Chonk! Also: Espionage at OpenAI

Shane Thomas (0:00)

Anthropic is updating its usage policy. The new rules prohibit sustained abusive or cruel behavior towards Claude. I think you're in trouble.

Abhi Aiyer (0:07)

I'm in trouble.

Shane Thomas (0:08)

And it is funny because if you ever deal with coding agents, sometimes I feel like getting frustrated because it's not doing what you want. Gets you better results.

Abhi Aiyer (0:15)

Yeah.

Shane Thomas (0:29)

Welcome to Agents Hour. It is not Monday. It's Wednesday, October 14th. There's a holiday on Monday. We had some traveling, but we're here. We're doing the news just like we do every week. I'm Shane. I'm one of the co-founders of Mastra. I'm here with Abhi.

What are we doing here this week, dude?

Abhi Aiyer (0:45)

Well, we're together in SF. We're having a little Mastra off-site with some of our Mastra employees. But we're live here at the CodeRabbit studio, one of our favorite places to record. And if you all don't know anything about CodeRabbit, CodeRabbit is a friend of the show, a friend of us. But the code review product, and actually more than code review now, so if you all are looking for some code review, you can get that. You can also have it explain PRs with CodeRabbit Explain. They have a new product called CodeRabbit Triage to help you kind of organize your software factory.

And finally, they have this awesome product that I have not used yet, which is CodeRabbit Security. And we just had some security vulnerabilities. I wonder if, you know, CodeRabbit could have helped us there as well.

Shane Thomas (1:32)

But anyways, we appreciate you tuning in.

Why don't we just go ahead and jump right into it? There's a lot of news today. OpenAI found a bug, but not your normal kind of bug. This is a literal bug. So this came out actually yesterday. It's from OpenAI Newsroom. We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI. And we got a little more details on this. It sounds like it was a bug planted in maybe an executive's meeting room that was kind of more for confidential conversations. It was planted behind a TV, maybe wrapped in toilet paper or something weird, something like that. So, undetermined exactly the intentions there. But apparently, one of the people or the person responsible was also working on the, I think, the OpenAI Agents SDK team. So, I'm assuming no longer at the company, obviously.

Abhi Aiyer (2:29)

Yeah, well, FBI. Good for us, though.

Shane Thomas (2:32)

Yeah, I mean, I guess. What a wild time.

Abhi Aiyer (2:34)

Yeah.

Shane Thomas (2:35)

Where you think that espionage is the answer, I guess.

Abhi Aiyer (2:39)

I wonder what they, like, listened in on, you know, AGI's here. Maybe they were talking about the DOTS launch, things like that.

Shane Thomas (2:48)

Yeah, I was only there for a couple days, but, you know, I guess, protect your secret conference rooms.

Abhi Aiyer (2:54)

Well, they were also saying that they used AI to, you know, pollute it, like, you know, Sherlock Holmes to figure out who, and I wonder if that's all real or not.

Shane Thomas (3:03)

Yeah, I mean, I think the answer is, if you find a weird microphone device, or some kind of weird device, you probably just know that something, yeah.

Abhi Aiyer (3:11)

Something's wrong.

Shane Thomas (3:12)

Yeah. That's not supposed to be there. But anyways, so that's the world we live in.

Let's talk about all the model releases. There's a ton that have come out throughout the last nine days or so, since we last did the show. First, Le Chonk. Le Chonk. This was kind of rumored like a while back.

Abhi Aiyer (3:30)

Yeah, it was the opus killer in France, which are like two things that don't go in the same sentence. Modals in Europe. But it actually is quite a good open source model, for the most part. Interesting thing about Mistral is their use case is predominantly in Europe, predominantly for military and government use cases in Europe. And, you know, France is the capital of AI in Europe.

So very much people in France do use Mistral.

People over here don't necessarily use or care about Mistral.

Shane Thomas (4:02)

Yeah, I mean, I think when they were one of the only open models in town, a lot of people experimented with it. But it is good to see that, you know, maybe there is some places in Europe that still have at least a pulse, which is a trillion parameter model, which is, you know, it's a mixture of experts, Modal, 49 billion, ActiveParam, it scored relatively high for open model on artificial analysis and some other benchmarks.