Everything You Need to Know About AI Tokens

**Nathaniel Whittemore** (0:00)
Today on the AI Daily Brief, an operator's cut episode with Nufar, everything you need to know about AI tokens. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI.
All right, friends. Well, Nufar Gaspar is back today, and Nufar and I have been cooking up a lot recently. A whole slew of you have done our most recent program, have explored our most recent program, the Choose Your Own Adventure style AI Summer Adventure. Plus, we've been cooking up an expanded set of educational resources that we'll be telling you about soon. But one of the realities that both Nufar and I have been living in is every company we interact with, dealing with the same questions of AI tokens and token economics. We are now firmly in the agentic era of AI, where companies have to think not only about how to get adoption and how to maximize AI's value, but how to do so in a way that doesn't just totally break the bank and where the right intelligence is being used for the right problems. Anyone who's ever built an open clock can tell you that getting the right models to do what you want them to without going off into endless cycles of spin takes some real consideration. Today's episode is designed to be the ultimate primer on AI tokens, what we're talking about when we say that term, what the new challenges are, and some of the key pitfalls to avoid as well as strategies to maximize the way that you and your company use AI tokens.
All right, Nufar, back with another operator's cut, talking about the topic du jour, the topic on everyone's minds, we are talking tokens. How are you doing?

**Nufar Gaspar** (1:35)
I'm good. Very psyched to talk about tokens.

**Nathaniel Whittemore** (1:39)
I love this period in a discourse where we've gone from pulling hair out, freaking out about the new change to actually settling into new tactics, new strategy, and I think this is a perfect fit with that. Tell us a little bit about what we're going to be talking about, and let's dive in.

**Nufar Gaspar** (1:55)
Good.
The reason why I wanted to do this episode is because every room that I walk into these days, literally every room, have some version of the same token conversation. Some practitioners feel like they are being watched when they use an expensive model. The regular users wonder whether one ambitious prompt will eat their weekly allowance, and the leadership teams, they see a bill growing faster than expected, and then they start asking a lot of questions on whether all of these tokens produced anything useful. I don't know where you guys are sitting, but there is a new anxiety around using too much intelligence, and I actually want to flip the conversation, first of all, to make sure that everybody understands what tokens are and what the bill actually means, and then how to spend them wisely rather than sparingly. That's why I'm here and what I'm planning to do today.

**Nathaniel Whittemore** (2:42)
One of the places that I found myself with this conversation is, there's been such a visceral reaction now as the cost has gone up.
I have a bigger concern around people retreating back to known ROI biases and, not boring, but ultimately low-stakes use cases, let's say, as compared to what AI can actually do. That I've found myself in the position of having to defend things like token maxing and token leaderboards, just relative to where the tone has shifted. I think obviously we'll get into today, the smarter version of that conversation, so I'm excited for it.

**Nufar Gaspar** (3:15)
Exactly. All right. Because there is a growing conversation around that, I think that there is a better language around the feeling of tokens shouldn't be just a financial thing. Just recently, the OpenAI CFO proposed a scorecard, and it was called Useful Intelligence per Dollar. That's built around the one question, what does each successful task actually cost? That's the conversation that I think people should have. I want to help you read the whole story. What are tokens? What do your work costs and where usage create value and where it quietly leaks value rather than adding? So to kick us off and how we got in here, I want to walk you through four eras of token consumptions. And probably we'll recognize where you are. And we all started by being basically token oblivious. That was the all-inclusive era, where model companies subsidized the usage and the flat subscriptions hit the meter. And many individual users and many of them are still there. Just see the ceiling, not a pair token price. So that's where we started. And then, like you said, we got into the era of token maximizing. That was the leaderboard era where usage became the badge of AI maturity. And we all remember some of the conversations around Meta who tracked employee AI usage on an internal leaderboard. They used to quality tech and they used roughly between 60 to 74 trillion tokens in a single month. And according to the data that was published, the top individual user used 280 billion tokens. So to give a sense of how many this is, that is roughly 2.3 million books worth of text. So if you want to try and imagine that, that's about 50 books every minute continuously for a month. So that was the Meta story. And then Uber launched also an adoption leaderboard and burned through the entire 2026 AI coding budget in about four months. And there was another company unnamed, but according to TechCrunch, they ran up $500 million of cloud bill with no usage limits in place. So then in that era, usage became the metric and dashboard measured activity while claiming to measure value. Obviously this was unsustainable and I know you have some opinions on that, but I'll be curious to hear your points, but I also want to say that it actually got us to be, as always, the pendulum took us way too far to the era that I call token interest, which is where we are. But if you have anything to say in defense of a leaderboard, I'm here to listen.