**Taylor** (0:00)
Welcome back to AI Signal & Noise. It is Monday, and dude, we have some absolutely wild stories today. I am Taylor.
**Morgan** (0:09)
And I am Morgan. Happy Monday, everyone. Ready to cut through the hype and see what is actually happening in AI.
What is first, Taylor?
**Taylor** (0:19)
Oh, we are starting with gaming, but it is actually a massive breakthrough for how AI agents think. Like seriously, mind-blowing stuff.
**Morgan** (0:30)
Let me guess, another language model playing a game? We have seen that with Minecraft and Doom. What makes this one different?
**Taylor** (0:38)
Okay. So researchers built this agent called AgentSTS to play Slay the Spire 2
And they solved the massive chat log problem.
**Morgan** (0:48)
Wait, the chat log problem? You mean how agents get slower and more expensive as the conversation goes on because the prompt balloons?
**Taylor** (0:56)
Exactly. Usually, the prompt grows to like over 500,000 tokens. But they replaced that giant chat log with five structured memory layers.
**Morgan** (1:09)
Five layers? That sounds complex. But I assume it keeps the context window much smaller.
How small are we talking here?
**Taylor** (1:17)
Dude, it keeps the prompt at around 5,000 tokens. That is a 99% reduction. And the agent actually wins games now.
**Morgan** (1:27)
Okay. That is actually impressive. Slay the Spire is a rogue-like deck builder. It requires serious long-term strategy.
What is the win rate?
**Taylor** (1:39)
It won six out of 10 games. And get this, the competing agents with standard memory didn't win a single game, not even one.
**Morgan** (1:48)
Wow.
Zero to 60% is a massive jump. So instead of just reading a massive diary of past moves, it categorizes its memory.
**Taylor** (1:57)
Yes. It has layers for things like current state, long-term goals, and current synergy.
It is like how a real human player actually thinks, you know?
**Morgan** (2:09)
It makes sense. We don't replay every single second of a game in our heads. We just remember the strategy and current deck state.
**Taylor** (2:17)
Right. I saw this on thedecoder.com, and researchers think the structured memory is the key to making agents actually useful for complex, long-term tasks.
**Morgan** (2:29)
It definitely points to a future where we don't just throw bigger context windows at problems, but actually design smarter memory architectures.
**Taylor** (2:38)
Totally! It proves that brute force isn't the only way.
Smarter architecture beats massive compute here, which is so cool.
**Morgan** (2:47)
Absolutely! It is a great win for efficiency. But let us see if this approach translates well to non-gaming agent workflows.
**Taylor** (2:56)
Speaking of agent workflows, that brings us to our second topic.
Have you heard of loop engineering? It is taking over machine learning research.
**Morgan** (3:08)
Loop engineering?
I have seen some talk about this. Is this about moving away from the classic chat box interface?
**Taylor** (3:17)
Yes. Like most people still use AI like a 2015 search box. You type, you read, you type again. It is so manual and slow.
**Morgan** (3:27)
Right. It is very turn-based. So loop engineering replaces that manual back and forth with an autonomous, continuous loop?
**Taylor** (3:36)
Exactly. Mark Techpost did a whole guide on this, featuring Andrej Karpathy's auto research repository and the bi-level auto research paper.
**Morgan** (3:47)
Karpathy's repo?
He's always at the forefront of this stuff. So how does an auto research loop actually function in practice?
**Taylor** (3:55)
So the agent basically writes a paper, runs experiments, analyzes results, and refines its own code in a continuous loop without human intervention.
**Morgan** (4:08)
Wait, it writes and runs its own machine learning experiments? That sounds like a recipe for infinite loops or just burning through API credits.
**Taylor** (4:18)
Totally.
That is why the by level part is key. It has an outer loop directing the strategy and an inner loop executing the code.
**Morgan** (4:29)
So a hierarchical system.
One agent acts as a manager and the other does the actual coding and testing. That prevents runaway loops.
**Taylor** (4:38)
Yes. And according to the write up by at 0xcodilla, this setup actually successfully discovers new machine learning algorithms. Like it is doing real science.
**Morgan** (4:51)
Doing real science is a big claim, but automating hyperparameter tuning and basic architecture search within a structured loop is definitely the next step.
**Taylor** (5:01)
It is just wild to think about AI agents doing machine learning research to build better AI. It feels so sci-fi, Ude.
**Morgan** (5:12)
It is a bit circular, isn't it? But highly efficient if they can get the guardrails right, so it doesn't hallucinate its findings.
**Taylor** (5:19)
Speaking of executing tasks, Anthropic just dropped a massive update for Claude 3.5 Sonnet's computer use API. It is insanely fast now.
4 more minutes of transcript below
Thousands of transcripts fetched by people building searchable podcast archives
Try it now — copy, paste, done:
curl -H "x-api-key: pt_demo" \
https://spoken.md/transcripts/1000651996090
Works with Claude, ChatGPT, Cursor, and any agent that makes HTTP calls.
From $0.10 per transcript. No subscription. Credits never expire. Prices exclude VAT, added at checkout for EU customers. Not what you expected? Email us within 14 days with 20 or fewer credits used and we refund the pack in full.
Using your own key:
curl -H "x-api-key: YOUR_KEY" \
https://spoken.md/transcripts/YOUR_EPISODE_ID