Claude Opus 5.5 AI Builds 3D Worlds Now

Julian Goldie (0:00)

Today, I want to show you how to build stunning 3D worlds. Well, you can see in this tweet from Mento, we're using Opus 5.5. So it's really powerful for building 3D worlds. Here's another example from Aurelion. So you can see this system, this is actually an open source, you can get the code for this. But it's very easy to build these 3D worlds. I'll show you a few examples that we created earlier today. So you can see this one, this is a self-playing Leviathan Sky game. And we've got another one here where we've created similar to what we saw previously. And if you look at the quality and the detail of this, it's absolutely amazing. We can also switch between day and night. So that can change as well. Let's open this up, this is another example.

But yes, it's unbelievable. You can build these 3D worlds, zoom in, zoom out. This was pretty much a one shot prompt as well. So it didn't take much to build them. And I'll show you exactly how it works. We also recreated the water example earlier today. Here's another example of that. Look at the reflections and everything else inside here. It's just really powerful and fun. And of course, the difference here is you could do this with Fable 5.1 before, but it would be a lot slower. And also it costs a lot more tokens and you'd run out of usage very quickly. So if you look at my usage limits here, you can see that we are nowhere near our weekly. Now, whether that's going to last, I don't know. But very impressive that we have not gone anywhere near our weekly usage, and we can still get the most out of it, which is unbelievable. Now, here's another example. So if we open this up, look at this self-playing 3D world here. It's really cool. And we can fly around. We can move it if we want to. We can zoom in and zoom out. But also it can actually play itself. So if we open up another tab, it can fly around itself and like the colors and the 3D world are beautiful. So how did we build this? Let's get straight into that and I'll show you how it works step by step. So what you're going to need is Claude Opus 5.5. I would recommend having the desktop app ready to go. Then you need a web browser and about five minutes, like it built it very quickly. And this is not using Unreal Engine or anything like that. I'll show you how it works in a second. So the first thing you want to do is pick your world, right? The place, the hero movement, how it walks, the mood. Is it calm, eerie, epic or cozy? And the time, the weather, right? Do you want sunset or do you want night or do you want rain? So if we look at these other examples, you got daytime, we can switch between night time and daytime over here.

And you can choose the vibe and the feel of everything else. From there, you use this prompt. So if you wondered how the prompt goes, basically we're going to say build a breathtaking real time 3D world in one self-contained HTML file using 3JS. So that's all we're using is 3JS to build this. I don't like to add sound to it. I don't think it's necessary, but you can if you want. So I put in the prompt, no sound. And then we're going to say everything made in code, no image files, because obviously Claude can't generate images. And then from here, we can put in the world, the hero, the player, the mood, the vibe, and everything else. And then from here as well, we have to set up the quality bar, right? So for example, we've put real looking shapes, not shadows or spheres. Otherwise it will lack the detail. Also soft cinematic lighting, fog for depth, glow on only things that should glow, living details, so the wind, the drifting particles, the water that reflects, and then a minimal on screen display. So if we go back to the Opus 5 example here, you can see we've got an on screen display in each of these, but it's very minimal, right? There's nothing really disrupting the 3D world itself.

And then drag to look around, and also it should work on phone. Really important part here is the FPS, as you can see right here. You want to test it and just make sure. Get Claude to test it itself. You don't do that.

So let me show you an example of how that works step by step.