Hermes Desktop Just Got 10X Better With Bot Screen Mode!

Julian Goldie (0:00)

Hermes Agent now has its own bot screen in the cloud, so it can control its own computer, and I'm going to show you exactly how this works step by step today. So what you can see is an example here, is that we have our AI agent inside Hermes desktop. So you need the Hermes desktop app, and then from here, you're going to go to your Hermes Agent chat, and you can see, for example, we said, open up Julian Goldie in bot screen mode, and it opened up directly. So if we go over here, you can see that we have our computer, set up, ready in the cloud, and Hermes Agent can operate it. So we can basically see what Hermes Agent does day to day. This can even work with schedule tasks, and this is inside the bot mode section of Hermes. So if you're inside Hermes, you've got all your normal chats over here, as you can see, and then you've got this section, which is the bot screen section, right? So if we go back to bots, and it's very similar to something like RockBot, we can go inside the chat here. We can say, okay, navigate to google.com, just as an example.

What it's going to do is it's going to open that up inside bot screen mode. So it's opening up, so you can see right here. And also the cool thing is when we're doing this, we actually get a live preview. So you can see as an example over here, we have a live preview of what's going on with our AI agents.

And we can also take over our AI agents whenever we want. So we can click on the takeover section, and we can navigate and control it like so as well.

So this is the new update. Basically, how this works, it runs on a Linux gateway host. You don't need to worry about that too much. But basically, what this means is that you are giving Hermes its own desktop to run from directly. And so it's using computer use, and then it's also got access to a browser as well. And every Hermes profile can have its own screen, its own browser profile, and its own cookies as well.

So all your agents or every single one of your Hermes AI agents can run with its own bot screen. Now, when you're running it inside the desktop app, basically, you can open up the bot screen session, and then it will look something like this at the top, and you'll get a preview on the right-hand side over there as well.

Now, you might also say, okay, why would you want to use this? Why not just use a normal browser? The cool thing is, number one, you can see what it's doing, and you can see the history. Number two, quite often AI agents get stuck on a login page, but with this system, basically, it can have its own logins, and it can remember stuff in the cloud for you. Number three, it doesn't overtake your screen. So for example, normally if you're using Hermes agent or any sort of agent, it can take over your whole screen and that gets messy. With this system, it's just running in the background inside its own session, and it's not opening up any tabs in your browser or anything like that, right? You can just carry on doing what you're doing. Also, it keeps running. So once it's on a Linux server, basically this will keep working even when you close the app or close your laptop and everything else. And also, each bot gets its own browser.

So you could have a research bot, you could have a social media bot, and they don't mix up anything. It just works directly. So if you're wondering how to use it, you just go to bots over here, and then you can open it up. You can have a look at the screen, see the session, et cetera.

And also, one thing that actually got Opus 5 to configure for me, Opus 5.5, is if we go inside our settings here, we just need to configure a gateway, right? So you can see this section, and basically what we want to do is go to our saved connections over here, and then we've got the bot screen to set up like. Now, you could configure that yourself. I've got lots of training inside the AR Profile Boarding, on exactly how to set up step-by-step. It's quite technical, as you can see. Or the other option that you can have is you can just go into Claude and you can say, hey, set this up for me, create this for me, use this for me, et cetera. And if you have any issues, just give it a screenshot, and then it can fix it for you, as you can see right here. So that works pretty well.