AI Outperforms Junior Accountants on Real Work | Edward Hu artwork

AI Outperforms Junior Accountants on Real Work | Edward Hu

MTS

October 28, 2026

Edward Hu, Head of AI Modeling at Mercor and former OpenAI researcher, explains how the company is evolving from data delivery to open-source model training and economic evaluations.

0:00

Edward Hu

A surprising finding is for the slice of tasks we cared about, which was very knowledge heavy, retrieval heavy, quite realistic, and they're often takes quite a lot of time to complete. For those tasks, actually, AI was able to outperform many junior accountants. And those junior accountants were sourced on our platform, was defined as people with less than five years of experience.

AI model 12 months ago could not have completed these tasks. But the models today are doing better than human, even better in some cases than AI plus human.

0:31

Sophia

Welcome back to MTS. Today, I am joined live with Edward Hu. He is the head of AI modeling at Mercor, and he was a former OpenAI researcher. So welcome to MTS.

0:43

Edward Hu

Thank you for having me, Sophia.

0:44

Sophia

Thank you for joining, Edward. I know right before we officially went live, we're talking about all the exciting updates with Mercor and how you guys are expanding a lot. You recently announced earlier this month, the new research team. Can you tell me a little bit about some of these updates?

0:59

Edward Hu

Absolutely. Mercor started out, and just for a quick recap, Mercor started out as a data provider to Frontier Labs and Neo Labs and increasingly more and more of enterprises as well. And we started out really focused on delivering high-quality data. But over time, we realized that the need for data is shifting drastically. We are moving to complicated our own environments, and we're really laser focused on measuring the economic value of AI, really building environments that mimic how people do actual work and how agents will actually work in practice for enterprises.

And as we push the frontier, we realized that increasingly we need research at a company on all levels, whether when it comes to the way we produce data, the way we measure how AI is progressing, or the way we are getting into model building as a means of improving our data, assuming our customers' needs. And also as AI is being deployed into the economy, many of our customers, especially enterprises, are wondering, what is the ROI of AI? What is the impact of AI on the future of work? And as a result, we're building an econ research team as well. So it's a very exciting development, and I think Mercor is becoming more and more of a data research company, and eventually an AI research company.

2:17

Sophia

This is pretty fascinating. We had on Eric Aden on the show on MTS a few weeks ago, who is also sharing about some of those updates. When you share about the economic impacts of AI, and that's direct data that you guys are researching and studying and putting out high level, what can you share about that?

2:35

Edward Hu

Yeah, so we are very interested in, number one, making sure that the tasks we produce, the benchmarks we produce, really reflect how people actually do work. And at Mercor, we are laser focused on closing the gap between what frontier models are capable of, and all economic available work.

And part of that is really mapping out what are the areas in the economy that we should be covering with our benchmarks, with our tasks.

And also a part of it is understanding where AI actually is at doing these economic available work. So Aidan's work was on Apex Accounting, a benchmark we co-created with Ramp. And there the goal is to really measure what are some of the realistic accounting tasks that an accountant will leverage AI to do. And there a surprising finding is for the slice of tasks we cared about, which was very knowledge heavy, retrieval heavy, quite realistic, and there are often quite takes quite a lot of time to complete for those tasks, actually AI was able to outperform many junior accountants. And those junior accountants were sourced on our platform, was defined as people with less than five years of experience. And that doesn't mean that the work of accountants is not important anymore. And it's very important distinction we're making in the blog that a task is not a job. But for this very narrow slice of the work that accountants do, we're seeing tremendous progression. AI model 12 months ago could not have completed these tasks. But the models today are doing better than human, even better in some cases than AI plus human.

4:14

Sophia

So tell me specifically about the research that you guys are doing that Frontier Labs aren't doing. So paint the picture if Mercor wasn't here, you guys didn't exist. What is that gap?

4:27

Edward Hu

Yeah. Frontier Labs today, first of all, I think they are working on all kinds of things, and I'm sure they are overlaps. But the research that we are uniquely positioned to do are ones involving, how do we actually best measure the economic impact of AI? We're in a unique position where we don't compete with the Frontier Labs or enterprises. Our goal is, hey, let's really figure out, how is AI doing?

Read the other 14 minutes of this episode here.

$15 gets you this episode and 99 more. Credits never expire. After checkout, one link brings you back here to read it.

Not what you expected? Full refund within 14 days.

Thousands of transcripts fetched by people building searchable podcast archives

Fetch transcripts with code

The same credits work from a script or an AI agent. The demo key returns a sample episode in full, no card needed:

request
curl -H "x-api-key: pt_demo" \
  https://spoken.md/transcripts/1000651996090

Markdown with the speakers named, for your notes, your knowledge base, or anything that makes HTTP calls.

From $0.10 per transcript. No subscription. Credits never expire. Prices exclude VAT, added at checkout for EU customers. Not what you expected? Email us within 14 days with 20 or fewer credits used and we refund the pack in full.

Using your own key:

request
curl -H "x-api-key: YOUR_KEY" \
  https://spoken.md/transcripts/1000798457566