Bonus Episode: How Can Organizations Better Measure and Manage Artificial Intelligence?

**SPEAKER_1** (0:02)
How do we know what kind of impact AI is really having? And how do we put the right guardrails around the artificial intelligence tools we're using?
That's the focus of the talk that we use to create today's bonus episode. As you might remember, Sam and Shervin joined the World Bank and Georgetown University for a forum on how artificial intelligence is shaping organizations back in December of 2023
In this episode, Sam moderates a panel of four experts to talk about just these issues. We hope you enjoy it and we also hope you're very excited for the premiere of season nine of Me, Myself, and AI, which returns on March 19th. Until then, please enjoy this episode.

**Sam Ransbotham** (0:38)
Olivia, start off. Tell us a bit about who you are in your background.

**Olivia Igbokwe-Curry** (0:43)
I'm Olivia Igbokwe-Curry. I lead Political and Congressional Affairs for Amazon Web Services and I also lead our AI federal policy.

**Nikolas Zolas** (0:53)
Hi, my name is Nikolas Zolas. I'm a Senior Economist with the Center for Economic Studies in the Business Research Area at the US Census Bureau and I've worked on some of Census's recent efforts to generate some national statistics on technology adoption and AI adoption in the US.

**Carol Corrado** (1:11)
I'm Carol Corrado. I'm a Senior Policy Scholar at the Center for Business and Public Policy at Georgetown. I previously worked at the Conference Board and also for the Federal Reserve.
My work involves studying intangible capital, digital innovation, and the role of technology in driving productivity.

**Scott Wallsten** (1:36)
I'm Scott Wallsten. I'm the President of the Technology Policy Institute. I'm also a Senior Fellow at the Georgetown Center for Business and Public Policy.
I study antitrust and regulation and broadband and AI and the economics of all kinds of things. Also, apparently, I'm not trusted with my own microphone.

**Sam Ransbotham** (1:56)
Yeah, we'll have to be open about sharing that.
Rather than go down the panel one by one, I'll keep people on their toes and start off with Carol who's just put her microphone down and ask you, we've talked about all this awesome stuff that people can use artificial intelligence for, but a lot of people are not particularly using it. What kind of barriers, what can we do to encourage that? What's keeping them from that? Do you have opinions?

**Carol Corrado** (2:24)
First of all, I think there's been a groundswell of interest in using AI since the release of Chat GPT in November of 2022, a little over a year ago.
And we found that, when I say we, the conference board found that in some surveys that it did in July and August, they have a regular survey of workers and their attitudes towards work. And they did a special one that asked whether workers used AI. And what they found was that among office workers, actually 56% of the people responded that they have used primarily generative AI in their work. Among marketing professionals, the response was even higher, like close to 90%. And there, they used it for, they used a mix of techniques.
This is organic, actually, because some follow on questions revealed that most people just did this on their own, on work time. But, you know, they educated themselves and applied these open source products that they found available to them. So I found that absolutely stunning. Again, I'm not saying 90% of workers, I'm saying 90% of people who work in marketing departments. I guess that shouldn't surprise us. I'm surprised at just how much workers are embracing the technology. This is not the policy of the firms that I'm talking about. And that's one thing that I think hasn't come up in our discussions today yet.

**Sam Ransbotham** (4:12)
That's very unusual in that typically we think about IT systems as being something that people must be forced to use and we have to incentivize it to use that. And this is a lot of organic use. We did a similar survey before ChatGPT and 66% of the people said they had not used or minimally used AI.
But then when we asked them, well, what about this tool, this tool, this tool? 43% of those people said, oh yeah, yeah, I use that.
I didn't realize that that counted. And so I think that we have a bit of a question about use and what does it mean to use? It's not a binary yes or no in terms of using. How do we measure use, Scott? Do you have a thought about how we measure use? What does use mean?

**Scott Wallsten** (4:56)
There are going to be, there are differences, obviously, there are differences between how companies use it and then how it changes the outputs. And those will each require different things. We've, I'm going to sort of take the question in turn a little bit. I put myself in a little bit of a different position than I usually am. I usually want to talk about data and the research we're doing.