Anthropic caught scientists using Claude to further bio weapon research, CA has new laws on the use of social media and AI chatbots by kids, and UMG is collaborating with ElevenLabs

SPEAKER_1 (0:00)

This episode is brought to you by Quince. That sweater that goes with everything, your perfect pair of pants, and that tee you always reach for are all perfect examples of what makes getting dressed easy, and that's what Quince does best. You see, Quince has high quality wardrobe staples made with premium materials like 100% Mongolian cashmere, organic cotton, and merino wool that you'll want to wear over and over and over again. Quince also makes premium pants, fitted tees and polos, and breathable activewear, quality basics designed for your life, whether you need to dress to impress or just feel good. It's what you'd expect from a luxury brand without the luxury price tag. Now, I have a bunch of Quince pieces that I'm constantly grabbing for, especially a pair of Pro-Tech golf pants I picked up that my wife says make me look like a million bucks. And I definitely feel like a million bucks in these pants while still being super comfy in them. Best of all, I can match them with just about any shirt or sweat or combo, so I get to impress my wife year-round. Oh, and you know Quince doesn't just make clothing. You'll also love their hotel-quality bedding, bath and kitchen essentials, and thoughtfully designed furniture. Find your next fall favorites at Quince. Download the Quince app for app-exclusive offers or go to quince.com and Engadget Next. Get free shipping on your order and 365-day returns, now available in Canada and the UK too. That's quince.com and Engadget Next.

SPEAKER_2 (1:26)

This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome, that's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50-page restoration block, or finally break down that long article you've had open for weeks. Gemini and Chrome is here for it. Ready to make anything online make sense? There's no place like Chrome. Check responses set up required compatibility and availability varies 18 plus.

SPEAKER_3 (1:57)

Anthropic caught scientists using Claude to further biological weapons research.

California has a few new laws on the use of social media and AI chatbots by kids.

And Universal Music Group is collaborating with ElevenLabs on a new AI-powered creation platform.

It's Friday, September 11th, and here's a quick look at some of the news happening in the sphere of tech this morning from Engadget.

Anthropic flagged and stopped multiple scientists who were using its AI models to create potential biological weapons. That's according to a new report the company shared on Thursday. Biological misuse is just one flavor of troubling AI usage, the report documents, but it is of growing importance because newer models like Fable 5 are increasingly good at helping with scientific research. The company's report includes five case studies of Anthropics models being used to develop biological weapons, the safety measures that brought the misuse to Anthropics attention, and how it responded. Detecting possible misuse is complicated, as the company stressed to the New York Times, because research into a new vaccine could look a lot like creating a bioweapon. In all cases, the company says it erred on the side of being overly cautious because of the possible consequences. Anthropics head of threat intelligence, Jacob Klein, told the New York Times, you're not seeing someone in a comic book kind of way say, hey, I want to build a biological weapon to kill everybody. It's an incredibly nuanced situation. In one case study from May, Anthropics says its biological safety classifier flagged a request for Claude to author a grant for gain of function research on chikungunya virus. That virus has no licensed treatment and can cause debilitating symptoms for weeks or months. Gain of function research explores methods for genetically altering an organism. In the case of this specific virus, the grant proposed increasing its transmissibility and ability to evade immune response. The combination sounds dangerous, and Anthropics says the fact that the proposed research was affiliated with a military research institute made it extra questionable. The company took similar issue with gain of function research into bird flu and a separate case of a researcher using Claude to develop an atlas of venom toxin peptides and a generative pipeline that optimized toxin characteristics. The full report also includes case studies on Anthropics models being used as a surveillance tool and to create software exploits, propaganda and weapons systems. According to the company, anyone misusing Claude or Anthropic models had their account banned, and the findings from the investigation are being used to further improve model safeguards and prevent future misuse. Given the tricky nature of biological misuse, Anthropic is also not naming the individuals or institutions its investigation connected to the development of possible biological weapons. Anthropic's people said that the individuals implicated in these case studies are working scientists, and the company does not assert that they intended harm, and identifying them or their labs could expose them to harm.