Magic: The Codebreaking Secret Behind Pearl Harbor, Midway, and Internment

SPEAKER_1 (0:00)

Picture this, it's the afternoon of December 7, 1941 You're standing in this grand office in Washington, DC., watching what is essentially a spectacularly surreal piece of political theater.

SPEAKER_2 (0:15)

Oh, you mean in Cordell Hull's office?

SPEAKER_1 (0:16)

Exactly, the US. Secretary of State. So two Japanese diplomats have just walked in, and they are carrying this formal 14-part message that officially breaks off diplomatic negotiations.

SPEAKER_2 (0:27)

Right, a massive, historically tense moment.

SPEAKER_1 (0:30)

But here is the mind-bending twist to this whole scene. Secretary Hull has to act completely surprised by this, even though he has already read the fully translated message before the Japanese diplomats even finished typing it.

SPEAKER_2 (0:42)

Yeah, he was putting on, like, the performance of a lifetime, because behind the scenes, the US had already achieved something the Japanese government considered mathematically impossible.

SPEAKER_1 (0:50)

And that is exactly what we are getting into today. Welcome to this deep dive. Our mission today is to explore the Allied Crypt Analysis Project, which is known as MAGIC.

SPEAKER_2 (0:58)

It's such a wild story.

SPEAKER_1 (0:59)

It really is. We're going to use our sources to unpack how the United States managed to break Japan's most secure diplomatic codes, the honestly bizarre bureaucratic turf wars that crippled the use of that intelligence, and the really controversial impacts of the secrets they uncovered.

SPEAKER_2 (1:17)

Right.

SPEAKER_1 (1:18)

I like to think about it like having a crystal ball that shows you all of your enemy's deepest secrets, but you're only allowed to look at it every other Tuesday, and you have to read it in a locked closet.

SPEAKER_2 (1:28)

That captures the sheer frustration of the whole Magic Project perfectly. Yeah. I mean, to understand how Cordell Hull got that message early on the day of Pearl Harbor, we really need to trace this long, invisible war of mathematics.

SPEAKER_1 (1:41)

Right, because this didn't just happen overnight.

SPEAKER_2 (1:43)

Exactly.

The US had been chipping away at Japanese cryptography for decades at that point. The sources point back to a project in 1923 code named RAD.

SPEAKER_1 (1:53)

I saw RAD in the outline, but I mean, how did we even get our hands on that initial intelligence back in the 20s?

SPEAKER_2 (1:59)

Well, it actually started with physical theft.

SPEAKER_1 (2:01)

Wait, really?

SPEAKER_2 (2:01)

Yeah.

A US. Navy officer managed to acquire a stolen copy of a Japanese naval codebook that was originally used during World War I. So they photographed it, brought it back to a newly formed research desk in Washington, and they basically kept the process code in these red-colored folders.

SPEAKER_1 (2:19)

Hence the name, but that seems like a massive lucky break, just, you know, swiping the rulebook.

SPEAKER_2 (2:24)

Oh, it was huge. It gave American crypt analysts a vital foothold. But by 1930, the Japanese government realized they needed better security, so they introduced a more complex system, code named BLUE.

SPEAKER_1 (2:36)

Okay, so they level up.

SPEAKER_2 (2:37)

Right. But the US actually managed to break BLUE by 1932

So suddenly, American military listening stations are actively monitoring Japanese fleet commands and ship-to-ship communications.

SPEAKER_1 (2:48)

Which is a huge advantage.

SPEAKER_2 (2:49)

It is, until everything hits a brick wall in 1939

Japan's ally, Germany, sent technical assistance to upgrade Japanese cryptography. They basically provided them with modified versions of the infamous Enigma machines.

SPEAKER_1 (3:00)

Oh, wow. The Enigma machines.

SPEAKER_2 (3:02)

Yeah, and the result was this brand new system the Americans code named PURPLE-A.

SPEAKER_1 (3:06)

Which means PURPLE-A wasn't just another physical codebook someone could steal from a desk.

SPEAKER_2 (3:11)

Exactly. The game fundamentally changed from manual cryptography to machine-generated ciphers.

With Red and BLU, you were dealing with additive or substitution codes.

SPEAKER_1 (3:22)

Like a decoder ring kind of thing.

SPEAKER_2 (3:23)

Yeah, think of it like a giant static crossword puzzle, where the letter A always means attack. Humans can eventually spot the patterns and just solve the puzzle. But PURPLE-A was a machine. It began its communications with a standard line of code, but then these mechanical rotors turned the rest of the message into an unfathomable jumble.

Because the rotors moved with every single keystroke, A might mean attack on Tuesday, but on Wednesday, A might mean supply ship.

SPEAKER_1 (3:52)

So code breakers tried to solve it by hand and just completely failed.

SPEAKER_2 (3:55)

Totally failed. The cipher was completely dynamic.

SPEAKER_1 (3:58)

And this is where William Friedman and Frank Rowlett enter the story. They led this team of US technicians who somehow, and this still blows my mind, managed to reverse engineer a machine to read PURPLE-LALI by 1939 without ever laying eyes on the original Japanese hardware.