Claude: How to Build an Agent Operating System!

**Julian Goldie** (0:00)
Today, I'm going to show you a fascinating agent operating system of Claude and Hermes, agents built into it to automate and create anything that you want. Now, this is something that I've been working on for the last couple of weeks, and it scares me, number one, how fast it's moving, number two, how powerful it is, and number three, how easy it is to build all this stuff, even if you don't code. I'm not a coder, I can't code, I don't know what I'm doing, but I built this video game generator this morning, just for fun whilst I was speaking to someone else, right? It was just working in the background for me. Here's another example of like a crazy game we built out inside this video game studio. And here's another one too, right? Now on top of that, what we can actually do is we can use something like Hermes Jarvis. Hermes Jarvis is a voice activated AI agent that sits on a wall. And if I switch on the wake word, it just listens for me and waits for me to say stuff, or I can click the button here and start speaking to it. If you wonder how that works, you can see a full transcript of me and the agent, just talking to each other, having our own little conversation. If you're wondering what it can build, here's some examples of what it can build. These are all cool stuff that is just built in the background again, with me using it as a voice-generated AI agent. On top of that, what we have over here is an ideas factory that can take any idea and then automate and turn it into an app, into, for example, a website, into, for example, built out a meditation timer over here. We can build and we can automate anything using these powerful AI agents with one single idea. Not only that, but I don't have to come up with the idea. So, for example, I can go into the agent group chat and I can be like, guys, give me some ideas for a game that we should build. They come up, they organize of each other, they critique each other's ideas and then we say, Claude, that's brilliant. Go off and build that. Claude actually adds it to our pipeline and this is for the agent rush game. Now if we go over to the pipeline and we have a look for the agent rush game that we've built out here, we can see it ready to go and we can just create it in one single click like that, right? Now if you want to indicate what can you actually build with this stuff, here's some cool stuff that we've built using this one click generator, right? And it's absolutely insane. I mean, look at this full website that we generated in one single click. We just went from idea, click a button, boom, the apps built, boom, the website's built and it actually looks pretty nice, right? It looks better than my main website, but it was generated with AI in one single click. Now you want to see something else that blows my mind? I've turned my brain into a galaxy that just floats through and we can navigate it like stars linked to each other. These are all individual memories of actual notes. Let me click on the open claw note. You can see the notes right here, right? And by the way, didn't create any of this. I literally just asked my AI agents number one, to start jotting everything down into an easy to organize system using Obsidian. And then guess what we did, right? Ask the agent, what should I build that would be useful? And he said, you should build a galaxy of stars as your memories inside a universe that you can navigate and fly through. And then, do you know what? The stars that burn the baryocyst should be the ones that you've most recently worked on. And so I didn't touch any of this, didn't come up with the idea, didn't even animate it, right? This is all created with Claude by me just going into Claude over here and creating what we want. Now on top of that, it's using all of our best AI agents and plugging them all together. So for example, we got Claude, we got Hermes, we got Gemini, Antigravity, Codex, free Claude Code. I can operate a free version of Claude Code with different APIs plugged in. It's actually a local model that's plugged into this system. And then I can use my voice to get it to build stuff like you can see right here, right? These are all things that we've built using my voice to create these different things that we've got right here. It's absolutely insane. Look at that. Actually works like, and by the way, just take note, none of this stuff is broken. Like it's all actual stuff that's built and looks pretty nice. Now on top of that, what's also blowing my mind here is that we have a studio where we can generate images, videos and voice in one click. It feels like an actual app someone has built, except it's not like anything fancy. It's just me using Claude and coming up with ideas and then actually getting it to implement my ideas. These are all videos created by Hermes that showcase different things is actually built, AI avatar videos, as you can see right here. It's created a living galaxy showcasing the memory galaxy for Obsidian. Here it's actually taken some ideas that we built inside the agent operating system, and then just turn that into a beautiful video. Now on top of that, we could also use Antigravity. Antigravity is pretty cool and we've got that plugged in like so. How do we do that? Again, we've got the CLI details on the open source project for Antigravity CLI, and then we plugged it into our system. Boom shakalaka, we've got everything ready to go. Now additionally, what you can see inside this section is that we have basically a whole gallery of different things plugged in. We've got a website, we've got this app. This is an SEO tool app for auditing websites for SEO. We have a full website built for an SEO agency over here. We have some images created, another website. And this is actually kind of like the connections and keyword galaxy for a topical authority map.