Local AI Will Take Over Within One Year | Ian Weinberg artwork

Local AI Will Take Over Within One Year | Ian Weinberg

MTS

October 31, 2026

AMD's Ian Weinberg demos the Ryzen AI Halo developer box live in studio with Sophia Dew, running massive AI workloads locally.

0:00

Ian Weinberg

Two years ago, if we were talking about local AI, there'd be a lot of skeptics coming up and saying, I don't believe this. Last year, there was engagement asking, how do I get this? Now the question is, how do I get more of these?

So the barriers to interest are gone.

0:14

Sophia Dew

Yeah.

Hello everyone, welcome back to MTS today. We are joined live in the studio with Ian Weinberg from AMD for a very special demo. I know you guys unpacked earlier the big Ryzen AI Halo, and we're going to actually test it live on air with this cool demo, and Ian's going to talk us through what it is and everything about it. So welcome to the show.

0:37

Ian Weinberg

Thank you. Hi Sophia. Yeah. So today, I am here to talk to you about the Ryzen AI Halo Developer Box.

Can I open by telling you a little bit about what it is? Please. Please do. Okay. First of all, first thing I want to do is put one of them into your hands, and we're going to talk first about what's in it, but then I also want to take a second to talk about what went into making it. So, inside of it is our next generation, Ryzen AI Max Plus Pro 495 processor. Now, from here on in, I'm going to call that 495, because that's a lot to say.

And really, the headline feature of the 495 is 192 gigs of shared RAM. So, why that's important is that can be shared between the CPU and the GPU, and when you look into the world of developers today doing local AI, what they run out of very often is memory. It's not the compute side of it, it's the memory side of it. So, of that 192, you can reserve 160 of it for dedicated GPU VRAM, and that unlocks 300 billion parameter models.

1:43

Sophia Dew

Wow. 300 billion parameter models that you can run using these.

1:47

Ian Weinberg

Like GLM 5.3 flash can be run directly on this box.

1:51

Sophia Dew

Okay. That's really impressive. And so, I was asking him earlier because I, for some context, we're breaking fourth wall today because we're doing a demo. So, we're breaking fourth wall. Thank you to the audience here who's watching. So, I had the pleasure of being at the AMD conference back in July.

2:05

Ian Weinberg

Advancing AI.

2:06

Sophia Dew

And so, Advancing AI, we saw the Halo Rack system actually being unveiled, and I was asking about this. And apparently, this would not have been possible back in July.

2:15

Ian Weinberg

So, the demo I'm going to show you exceeds. So, back in July when we were on the 395 version that had 128 gigs. And actually, one of the things I wanted to mention about this is, take a look at the industrial design. And when you look closer, you'll see that every one of these little pieces here is an AMD logo.

2:32

Sophia Dew

Wow, that's beautiful. If you have the close up version here, I'm not sure what the camera is, but you can see the very close up AMD really just on here.

2:41

Ian Weinberg

It's just hundreds and hundreds of AMD logos. But it's a beautiful piece. And the thing that we mentioned there is that 300 billion parameter model runs on a box that is basically the size of a book, less than two inches tall.

And inside of it is a suite of tools that are meant to help developers of all abilities.

2:59

Sophia Dew

Wow.

3:00

Ian Weinberg

So when you turn it on, the first thing you'll see, I don't know if you want to jump right into the demo.

3:05

Sophia Dew

Let's just jump in the demo because I think what's pretty interesting is oftentimes, sometimes you can see the hardware, but then when you plug it in or try to install it, you have no idea how it should actually run. And what's really unique about hardware and software, is there's certain ways you can actually run the hardware to optimize it, make it as efficient, but often they're separated. So, I mean, for a little bit of context, I came from a developer background. I was really obsessed with open source models. I would try to figure out what hardware I needed at home to actually run my own open source models, and you kind of have to like, you're like Googling different software, installing different things, and then testing it. They're always separated, right? This pretty interesting because it looks like as you actually install it, your computer, as you plug it in, you start to see something that just pops up and you get to understand how to run these things with its ultimate capacity. Because you can run something on it without using all of its capacity, right? Depending on how that software is designed. So maybe that's a good intro to your demo.

Read the other 23 minutes of this episode here.

$15 gets you this episode and 99 more. Credits never expire. After checkout, one link brings you back here to read it.

Not what you expected? Full refund within 14 days.

Thousands of transcripts fetched by people building searchable podcast archives

Fetch transcripts with code

The same credits work from a script or an AI agent. The demo key returns a sample episode in full, no card needed:

request
curl -H "x-api-key: pt_demo" \
  https://spoken.md/transcripts/1000651996090

Markdown with the speakers named, for your notes, your knowledge base, or anything that makes HTTP calls.

From $0.10 per transcript. No subscription. Credits never expire. Prices exclude VAT, added at checkout for EU customers. Not what you expected? Email us within 14 days with 20 or fewer credits used and we refund the pack in full.

Using your own key:

request
curl -H "x-api-key: YOUR_KEY" \
  https://spoken.md/transcripts/1000799111564