Malaysia and Singapore step up Nvidia AI chip probes as charges brought against Chinese national over 917 smuggled servers — firm at center of Jensen Huang controversy announces inventory audit to account for all restricted GPUs - Tom's Hardware

Skyler Monroe (0:10)

Hey, everyone, welcome back to the AI Hardware Show. I'm your host, Skyler Monroe. And if you're into the silicon and semiconductors powering the AI revolution, you are absolutely in the right place.

Big thanks to our sponsors keeping this show running, Ada, which helps businesses integrate AI into their workflows in a real meaningful way.

Ago Consulting, that's Ago, your go-to for silicon development consulting from AI to SoC design, and Zen Semiconductor, an umbrella company building the processors and AI fabric behind modern data centers, with ventures like their Sierra RISC-V CPUs and Loom AI fabric, and they've also got Ada in their portfolio for deploying AI at scale in any business.

Today's episode is a good one. We're diving deep into the Nvidia chip smuggling scandal that's heating up across Southeast Asia. What SK Hynix's big Indiana move means for the memory shortage could stretch all the way to 2030 and South Korea's ambitious half-billion-dollar bet on on-device AI chips. Let's get into it. Alright, let's kick things off with a story that honestly reads like a geopolitical thriller. Malaysia and Singapore are ramping up investigations into Nvidia AI chip smuggling, and Singapore has actually filed charges against a Chinese national in connection with 917 smuggled AI servers. 917 servers? That's not a rounding error, that's a fleet. So here's the background. The US government has placed strict export restrictions on high-end Nvidia chips, things like the H100 and H200 GPUs specifically to prevent them from flowing into China and bolstering its AI capabilities. These restrictions are a big deal because these chips are essentially the engines of modern AI training. A large language model without them is like trying to win a Formula One race with a lawnmower engine. Now, the concern is that chips are finding a workaround. Instead of going directly from the US or Nvidia supply chain into China, they're being routed through third-party countries, places like Malaysia and Singapore, and then quietly re-exported. It's a classic gray market play, and it's apparently been happening at significant scale. The firm at the center of all this, which has also been linked to some controversies surrounding Jensen Huang, has announced it's conducting an internal inventory audit to account for all restricted GPUS. And look, an inventory audit sounds boring, but in this context, it's actually a massive deal. You're talking about a company essentially being asked to prove it knows where every single one of its high-value, export-controlled chips actually is. That's like a jewelry store being told to account for every diamond after a robbery tip.

Singapore moving to criminal charges is significant. This isn't just regulatory hand-wringing, somebody is facing actual legal consequences. And Malaysia stepping up its probe suggests these two countries are feeling real pressure from Washington to get their houses in order. The US has made it clear that allowing transshipment of restricted chips is not something they're going to look the other way on. From a hardware perspective, let's just appreciate for a second why these chips are worth smuggling in the first place.

Nvidia's H100 and H200 GPUs were going for multiples of their list price on secondary markets. We're talking chips that list around $30,000 each being resold for 40, 50, even $60,000 a unit in some cases.

When you're moving 917 servers, each loaded with multiple GPUs, the financial incentive to work around export controls becomes pretty staggering. We're potentially talking about hundreds of millions of dollars worth of hardware. The broader implication here is that export controls alone are not a perfect solution. They create scarcity and price premiums that actually incentivize smuggling. It's the same economic logic you see with any prohibited good. Make something artificially scarce and valuable and you create a black market. The US is essentially playing whack-a-mole, and Southeast Asia is the new front in that game. This story is going to keep developing, so definitely watch this space. Now this next story connects directly to what we just talked about. Because if chips are being smuggled, it tells you something important about supply and demand. And the demand side of the equation is not letting up anytime soon.

SK Hynix has announced it's going to start AI chip production at a new facility in Indiana. But here's the kicker, not until 2029 And the company is projecting a memory shortage that could last all the way through 2030

Let me give you a little context on SK Hynix for anyone who might not be as deep in the memory world. SK Hynix is one of the big three memory manufacturers globally alongside Samsung and Micron. And right now, they are the leading producer of HBM, which stands for High Bandwidth Memory.

HBM is the special sauce that makes AI accelerators like Nvidia's H100 and H200 so powerful.