What to Use the Latest AI Tools For

Nathaniel Whittemore (0:00)

This week had so many new AI and model product releases that I've had to do not one but two episodes just to capture everything that's been going on. What's interesting about this second set is that many of them show some pretty distinct and important trends about where we're headed. For example, it is very clear that we are going to be managing more and more of our interactions with computers via our voice. It won't happen all at once, but now that we have things like ChatGPT Live available to developers to build around with a significantly increased capability set, better ability to distinguish who's talking, background noise. You're just going to see more and more applications that involve voice. Another example of a trend shown off in these announcements is the continued push towards complex model architectures, where people can optimize for cost and good enough capability, as opposed to just always seeking the highest capability. The point is that sometimes new product releases are about what you can do with them, and sometimes they're about what they say about what we're all going to be doing soon.

The AI Daily Brief is a daily podcast and video about most important news and discussions in AI.

Welcome back to the AI Daily Brief Headlines Edition, all the daily AI news you need in around five minutes. We kick off today with a new report from Anthropic that details their efforts to detect and counter AI misuse. There were a lot of juicy nuggets in this thing, and were it not for the larger AI Safety conversation happening this week, it probably would have been a bigger topic of conversation. Going through some of the highlights, Anthropic said that they had disrupted major distillation attacks from Alibaba, DeepSeek, and Xiaomi. Each company used networks of fraudulent accounts to extract reasoning traces from Anthropic models for use as training data. However, Anthropic also claimed that they had detected both DeepSeek and KimiK3Maker Moonshot routing requests to Claude and serving the responses to their users. Anthropic wrote, in one instance, over a 10-day period, Moonshot relayed almost 300,000 customer requests to Anthropic, the vast majority of which were routed to Opus. Based on the report, it doesn't seem like Moonshot was using this method to spoof their models, using an Anthropic backend to make them appear more capable.

Instead, it seems like this was a way to gather realistic user queries for their distillation pipeline. Still, Anthropic notes that this method exposed sensitive information from Chinese government and corporate users on multiple occasions. In the biology section, Anthropic discussed an incident in May when a classifier blocked work on a grant application for scientific funding. The application discussed gain-of-function research on a mosquito-borne virus called Chikungunya. Anthropic wrote, because Chikungunya circulates naturally, a deliberate release as part of a bioweapon would be difficult to distinguish from a natural outbreak. The grant sought to identify enhancing mutations of the Chikungunya virus, engineer them into infectious clones, and select for virulence in vivo. In other words, the virus would become progressively more harmful as it repeatedly infected live animals, with researchers keeping the most disease-causing variants in each round. Anthropic noted that this research could have innocent applications in vaccine development, but they were concerned it might have been malicious because research was intended to be conducted at a military research institute. The report did not identify which nation was sponsoring the research, but did note the AI prompts continued through gray market resellers after the researchers were banned. The report also contained dozens of other examples of blocked misuse, including Russian actors using clod for espionage and propaganda, Chinese, Russian, and Romanian actors attempting to write software for conventional weaponry and a host of attempted cyber attacks and financial scams. Anthropic noted the report was put together with intention, writing, The cases we share here aren't typical misuse, but rather examples of the most notable and novel threat activity we've identified to date. We're publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. As models become increasingly capable, their risks will increase unless AI developers and society's defenders act to make them safer.

Notably, the report was entirely focused on misuse of Haiku, Sonnet and Opus models, with only a single case of distillation related to fable and mythos.

Now, speaking of the changing winds around AI risk, Sam Altman has told staff he's open to an AI slowdown. During an all-hands meeting this week, Altman told his team that OpenAI could pace the development of new AI models. However, he said this would likely happen in coordination with other AI labs and expressed concerns that not all rivals would agree. These comments come after a wave of discussion about slowing the pace of AI development that started even before Jacob Cox's viral tweet earlier this week. Many OpenAI staffers signed on to the Pacing the Frontier open letter in July, and Chief Scientist Jacob Pachocki recently warned that recursive self-improvement amplified the case for a slowdown.