NEV Jev AI Voice Browser Agent is WILD!

Julian Goldie (0:00)

Jev AI Voice Browser. You can now talk to a real browser, and it moves before you finish your sentence. This is a new project that just got released by Moritz Kremser. Shout out to him. And basically, this is a free GitHub project that you can use with Jev AI to control your browser. Let me show you an example of how it works. So we've got the browser set up here, and basically it listens to what I'm doing, and then it follows my instructions based on this, right? So you can see the previous history, you can see the decisions, and if you're wondering, okay, how does Jev AI work or anything like that? I'll come on to in a second. But if we open this up and we have, for example, Chromium over here, which we can control with our voice using Jev AI over here, we can say, okay, start the mic, and open up Google for me.

And boom, look at that, look how fast it is. Open up bbc.com, open up Google, and then we'll stop the mic there.

So, I'll close this. But you can see how powerful and easy that is. Now, the way this works, I'll break it down step by step for you. It can basically move, and you can talk to a real browser, and it moves before you finish your sentence. So, you can say, for example, I go to dot dot go, and the page is already loading as the last word leaves your mouth. You can say, for example, scroll down a bit, click the models link, open a new tab, and a real browser window does it with your hands off the keyboard. And you can set this up to run locally on your machine. You can see a demo of it working right here as an example. And this is pretty powerful and fun to use.

So, you can see how it works right here. You can control it with your voice on the right hand side, and then on the left hand side, it can open stuff up for you. And there's basically three parts to this.

Your voice, a model that decides, and a real browser. So, what is this? Well, basically, it's a small app, the developer called Moritz Kremper on Github on September the 8th. The code is open source, and it carries an MIT license as three parts. So, step number one is your voice goes into the speech tool that's built into your browser. So, for example, like Chrome. And that turns it into words as you speak. Those words go to a model named Jev, which makes the decision, and a tool called Playwright moves the real browser window. And that's the same tool developers use to test websites, so you can click and type like a person would. Now, Jev actually can't write a single word. It only picks an answer. So, if you saw my tutorials on it already, this came out earlier this week from a company called TypeSafe, started by Diego Amada, right? Now, Jev, it can't write a single word. So you can hand it a situation and a question with set answers. It picks one and tells you how sure it is with a number between and 1

So, for example, last week, I actually used it for keyword research, sorting and that sort of thing.

Now, this asks again every time a new word arrives. So the old way is the left hand side, the new way is right. So what's actually new here? Well, voice control has been around for years. AI agents that click around a browser have been around a while too, and you can run them every single day if you want. The new part is when the decision happens. So most voice tools wait for you to stop talking, and then send the whole sentence to a big model, wait for it to think, and then move. This one asks Jev again every time a new word arrives. Each ask takes well under half a second. So by the time you finish the sentence, the answer is usually already sitting there. And if you keep talking, the old ask actually gets canceled, and a fresh one goes out. So you want to picture it like a waiter who stops writing the moment you change your order. So if we have a look over here, for example, this is the system we've set up. You can see the log over here, and you see everything they've created.

Now, each time you use it, it asks Jev about 10 questions in one go. You know, what does this person want? Go somewhere, search, click, type, scroll, go back, switch tab. Which thing on the page do they mean? Which website? Have they finished the sentence? Are they even talking to me? How far should I scroll? Which of their words should go in the search box? And Jev basically answers them all at the same moment, so 10 questions take about as long as one. So in my runs, each request carried nine questions and came back in around 400 milliseconds. So if we go back to Cremium here, which is where we can control the voice browser, and then we can start the mic over here. Open up Google in a new tab. Type into Google AISO. Press Enter. So you can see how fast it moves. So I actually wanted to know how that compares. I actually ran a small test, and we tested the same pages with the same A commands. Now Jev answered nine questions each time over the middle time of 445 milliseconds, and got all eight right. Then the same pages went to three fast models people use every day with one question instead of nine. So we just tested out Claude Haiku, and that took 1.6 seconds. Gemini 3.8 Flash took 2.2 seconds. G50 5.6 Luna took 2.5 seconds. Each of them got seven out of eight. So why is Jev quicker? Well, a normal model reads out age and then writes his answer out. One small piece of type. Jev reads a page and hands back a handful of numbers. It's the gap between a multiple choice test and an essay question. There's nothing to write, so there's nothing to wait for. Now, this is a small test, eight commands, and those models weren't tuned for this example, but you can feel the gap and use it. A half second feels like the browser is basically listening to you and ready to act straight away.