Sign-In With GPT, Anthropic Vs. the Pope, Paramount Rebrands as Skydance | Diet TBPN

John Coogan (0:04)

Oh, we're getting Christmassy up in here, okay.

Ben Affleck (0:06)

Here we go.

John Coogan (0:06)

Very Christmassy, it's Q4. We're in the correct season now, so we can get pretty Christmassy.

Jordi Hays (0:13)

That is right.

John Coogan (0:15)

It's pretty tricky to stay in the little reef there.

Jordi Hays (0:17)

Enough about Christmas, John, let's get into the news.

John Coogan (0:20)

Let's talk about artificial intelligence. Yeah, so make it less Christmassy, it's too Christmassy. It's 83 years away.

This is no more than 20 days away before we get that Christmas.

Jordi Hays (0:34)

I'll just leave this on.

John Coogan (0:35)

Yeah. So there was this funny moment in Dev Day this week where everyone's focused on the war of DOS versus Muse versus Instinct. There were a couple of times where you're like, I want to talk about sign in with ChatGPT, which is the most boring and minute feature, and very much not in the drama war for the personal agent, like who's going to do your shopping, who's going to book your reservations.

Jordi Hays (1:00)

No, I just thought it was cool for independent developers, small app builders.

John Coogan (1:04)

It's actually probably more immediately relevant to the community that was there, like the developers, right?

Jordi Hays (1:11)

Yeah, and do you remember when, flashback to two years ago, people were creating these magical new product experiences with the best models at the time, but they were, in hindsight, pretty rudimentary. And they would build something magical, scale up really quickly, and then be like, oh, I just got stuck with like a $30,000 API bill. And so this is the solve for that, because it allows users to bring their own compute.

John Coogan (1:35)

BYOC.

Jordi Hays (1:36)

BYOC.

John Coogan (1:37)

Everyone knows BYOB. Now we're in the era of BYOC.

And yeah, like, you know, most companies, they could usually figure out a way to say, hey, like, this service is going to use a ton of compute, so you got to jump on the pro plan immediately. You got to set up a consumption, a credit card relationship, API credit, something like that.

Metered billing. But it was just an extra step, an extra point of friction, of you saying like, okay, I already paid 10 bucks a month for this thing, now I got to actually pay for inference, and this gives like a different off take. So yeah, Peter Yang was feeling the same way that you were. He said, I'm excited about DOTS, but even more excited about sign in with ChatGPT feature. Letting users use the ChatGPT plan in your website or app makes a bunch of indie apps a lot more viable.

Example, I have a live language learning app that I wasn't planning to launch to users due to API costs, but letting users sign in with ChatGPT makes this viable. Hope they roll it out to non-enterprise folks. Soon Vignesh, who's actually running the project, said, I'm gonna try and answer a bunch of questions that people have raised about signing with ChatGPT in the next couple of days. Before that, I wanna let you know why they shipped it. The bring your own subscription stuff, it sticks out because it feels like it's potentially like the beginning of a new economic structure. Like, is this an app store where there will be a margin to cruise to OpenAI or is this more just like better for discovery? Will agents reach for these because the sign in is available? How much more smooth will this get? But at a high level, I think you described it well, a user can sign in to an app or service. The Notion example is a good one because it's very intuitive. People already pay for Notion. You can imagine all the AI features that are there.

People were probably on day one of ChatGPT launching, copying from Notion into ChatGPT, copying back into Notion, writing bindings. But if Notion wants to offer a whole bunch of inference opportunities and agentic features inside, then they got to go to other clients and say, hey, you're paying 10, 20 bucks a month for your seat. We also need a bunch of money for inference. This offsets that. The way it works is a user signs in to an app like Notion, then authorizes the app to run the open AI model requests against their plan without managing an API key. On Notion, this means drawing from the GPT allowance instead of Notion credits, and it makes a lot of sense for bigger companies that have inference bills, as you mentioned. They've all had to grapple very quickly with product tokenomics, which is just a new economic muscle and price elasticity curve. They need to ride effectively. But the big thing is that it should, over time, allow leaner teams to offer inference hungry features with way less friction. It's worth clarifying that the feature only brings open AI tokens along for the ride. It's not open AI dollars, which is, I think, a way where this could go. But the good example is, let's say you have some sort of AI book publisher, where you're doing a bunch of token inference to generate the text of the book. You say, hey, I want to go take this general story, turn it into a book, and then print it and send me the book. There's two costs there. One's inference, one is...