Meet AlphaEvolve: The Autonomous Agent That Discovers Algorithms Better Than Humans With Google DeepMind’s Pushmeet Kohli and Matej Balog

**Sarah Guo** (0:05)
Hi, listeners, and welcome back to No Priors. Today, we're joined by two of the key folks behind one of the most compelling developments in AI this year, AlphaEvolve. Pushmeet Kohli and Matej Balog worked on this autonomous coding agent that uses Gemini models and evolutionary search to discover new algorithms. It marks a major leap in AI's ability to contribute to core computer science and math, and perhaps science is beyond that. It's not just a stochastic parrot or a boilerplate generator. It has shown what you might consider technical creativity in the way that MOVE37 did with AlphaGo, something humans hadn't done before, even in thousands of years of play. It might even be a real step on the path to self-improving AI. Pushmeet, Matej, thank you so much for being here.

**Matej Balog** (0:46)
Thank you for having us.

**Pushmeet Kohli** (0:47)
It's a pleasure.

**Sarah Guo** (0:48)
Congratulations on the success and the launch of AlphaEvolve. Can you give me a brief description of what it is broadly?

**Matej Balog** (0:56)
Yeah, so in maybe one sentence, AlphaEvolve is an AI coding agent that is able to discover new algorithms that are able to make new discoveries on open scientific problems. And at the same time, those algorithms can be so practical that they are already deployed in key parts of Google's own infrastructure.

**Sarah Guo** (1:15)
What is the origin story of working on this particular form of coding agent or this problem statement?

**Matej Balog** (1:22)
So we are not new to this space of algorithm discovery. As you might know, the mission of all of DeepMind is to build AI responsibly to benefit humanity. And the way our particular team has been doing it for years now is to look for ways how AI can discover new algorithms. New algorithms are everywhere around us. So this is a very, very important question and can have very high impact when we can discover algorithms that solve important computational problems with higher efficiency than what we have been able to do so far. And kind of the first breakthrough we had in this space was in 2022, when we released a system called AlphaTensor. And so that was a system that was an AI system using reinforcement learning, that for a very specific but fundamental computational task, so multiplying matrices for the first time showed that AI agents can discover better algorithms than what humans had been able to do before them. So this was the first system that gave weight to this idea that indeed with AI, we'll be able to go into the superhuman region of algorithms that we as humans have not been able to discover ourselves.

**Sarah Guo** (2:31)
How do you differentiate AlphaEvolve from AlphaTensor and FunSearch and some other projects in this lineage of this?

**Pushmeet Kohli** (2:39)
One way to also describe what we have done is if you look back at the history of DeepMind and see a number of projects that have come even before we started working on computer science. Our earlier work, and if you go back to the project on AlphaGo, where the AlphaGo agent was able to beat the WorldGo champion in the game of Go.
The remarkable thing in that agent was that it was able to explore this amazingly large search space of all possible Go positions in such an efficient manner that it can come up with what is the optimal move at that time, and really surprised people, both Go professionals as well as scientists. Scientists believe that that event would come much, much later because it was a very hard problem. And so what that gave evidence for is that, is the ability of these large scale neural network based systems to be able to reason and do very efficient exploration in these large search spaces. And come up with amazing new insights about the particular domain. And in the game of Go, I mean, there is this move called Move 37, which is a very creative new move that the agent discovered, that was not in the Go literature, right? That really surprised the Go professionals. So in some sense, we asked ourselves the question that if you have an agent which can do very efficient search in the domain of Go, why can't you use the same kind of philosophy to search for algorithms in the space of algorithms? And in fact, that sort of was the underlying basis of the work on our first sort of attempt at that problem, which culminated in AlphaTensor. So how we structured the algorithmic discovery problem is we looked at first a very important problem, and that problem was matrix multiplication. It is a problem that is ubiquitous in computer science. It's one of the key fundamental operators that underlies not only computer science, but also neural networks and machine learning and AI. And we said, can we find a way to improve matrix multiplication algorithm? So there's a history of matrix multiplication, which is very interesting for people who might be interested in it.