**Julian Goldie** (0:00)
Today, I'm going to show you what I'm building with this Claude Agent Operating System that combines, for example, Fable 5, everything that we've built with it. We've got, for example, Hermes, Voice Agent, Hermes Oracle, that could pull in the latest news, a full outreach tool, mixture of agents, and everything else that we're doing together. And I'm going to show you exactly how this works, step by step, what we're building with it, and the progress we've made so far. So I started building this out about two months ago, and it was really just like a kind of fun project where I was like, okay, let's try and just build out a basic mission control. The reason that I did this is because when we were using this, like if you're using the terminal, if you've got, for example, Claude in another tab, none of it is really linked together. It's all super messy. There's no memory stored between anything, and also you can't see everything you've built, right? And also the other problem here is like, I can't customize terminal. I can't make the UI more beautiful, but I can design my own operating system like you see right here, where we've got everything plugged in together. And the other thing that I've learned from this is like, because we've built this for AI Profit Board and community members, every single request that we get is kind of like, oh, that's a new idea. That's something new we could add. That's something we were missing before. And so every time you build a new feature in, it unlocks another door to something else that you could add on top of that. Let me show you an example of this. So for example, we built in Hermes Agent here, and really right when we began, it was just a chat. It was just literally like a chat and then you could have Claude CLI chat. And what we did from there is we started building out separate chats with different profiles. So for example, every time something new and useful comes out, like for example, Quen 3.7 or Grock Build or Kimi K 2.7, well, let's create a new profile for that so we can chat between them and see what we've created. Now also because Hermes keeps releasing like these new amazing features, like for example, Mixture of Agents, we were like, right, okay, let's plug that into the system as well so that we can use it whenever we want. Because again, if you were running through the documentation or if you were trying to use those separate features, it would be super messy. Let me show you an example of that. So if we go to Hermes Mixture of Agents and documentation on it, it's all like terminal commands, it's all coding, it's super complicated to use, but it's really powerful, right? Like I've actually tested this out versus Fable 5 today. And on many examples, Hermes Agent is either right up there with Fable 5 or actually beaten it, which is incredible when you think about it, considering it's using older models together. So my point here is like every time we get something that comes out is brand new from Hermes Agent, we plug it into this system right here. And I think that's a fantastic way to do it because instead of like going into the terminal and trying to remember how to use Mixture of Agents or like losing all the creations that you make with Mixture of Agents, because they're in just like a folder locally somewhere, you can have everything organized, it's neat and tidy, and it looks and feels exactly how you want it, right? And so that's what I'd recommend for you if you're thinking about doing this, segment each piece of Hermes you actually use. Now, that is another point too, you don't want to build too many features into this, you want to keep it simple and easy to organize because, for example, you might look at this list of CLIs, and because I test everything, we build in there. But actually, you might only need like Hermes and Claude, you might only need Claude inside here, you know? That's the difference is like you don't need everything, you just need the stuff you actually use. Now, something else that blew my mind is the Hermes voice agent that we have here. This is a voice activated version of Hermes that we can wake up with a wake word, we can use it in real time.
If we actually say something to Hermes agent right here, it will actually reply to us as well, which is great.
And then also the great thing about this as well is that when we are using this voice agent, it can also control our browser and also control things locally, and it just listens to us in real time. So we can have it in the background on a monitor, it can just talk and reply to us at any point. We can also see the full conversation over here, and you can see that it actually just took what I said and then plugged it in.
12 more minutes of transcript below
Try it now — copy, paste, done:
curl -H "x-api-key: pt_demo" \
https://spoken.md/transcripts/1000651996090
Works with Claude, ChatGPT, Cursor, and any agent that makes HTTP calls.
From $0.10 per transcript. No subscription. Credits never expire.
Using your own key:
curl -H "x-api-key: YOUR_KEY" \
https://spoken.md/transcripts/1000775253045