Nobody's Week Changed

Does the work actually get better?

One of the first agents I built worked exactly as designed. It searched for reference material in the cases where an existing tool came up empty. I was praised for it. Nobody's workload changed, including mine: it saved me about a minute, because I could already run those searches one at a time. The interesting part is that I was praised anyway. From the outside, the existence of an agent was proof the team was doing something with AI. From the inside, as its only user, nothing about my week was different. Activity with AI had started standing in for value from AI, partly because activity is countable and value is not.

What changed: The filter I use now is whether the task is repetitive, whether it eats real time, and whether someone would reach for the tool in a normal week without being told to.

Was it designed with the people who do the work?

When I designed a one-month AI project for a summer intern, I could have handed her a list of agents to build. I didn't know what anyone else actually needed, so we started with the people doing the work. The client service associates supplied the context: which steps were slow, what the output had to look like, where the exceptions were, what "good" meant. They already knew what they wanted changed; what they didn't have was a way to build it, so they handed the execution to her. She had to learn each process well enough to explain it before she could hand any of it to an agent, which is the step most easily skipped. The month produced eight documented agents across account opening, client communication and investment data, plus a handoff package for each. Adoption is partly verified: some moved into real use, she watched one associate use one daily, and one was still being refined on her last day. The other thing the month produced was the person. She told me at the start that she was afraid she couldn't do the project. She finished it able to teach the platform to other people.

Will someone fund the test, and is there a route to run it?

I found an outside research tool that could pull live financial data in ways general-purpose models couldn't. I proposed a deliberately small test: give a few people access, don't force anyone to use it, watch who reaches for it and for what, then compare that against the seat cost. It died twice, independently, before a single person touched it. Leadership found the analysis convincing and still declined to fund the test; the cost wasn't out of line with what the team spends elsewhere, so I read that as a statement about priority rather than affordability. And being available through an approved platform didn't make the vendor itself approved; I worked through several internal functions and none could point to a route available to a team at my level. So there's no usage data and no ROI number. The absence is the finding: a pilot is a way to buy information, and someone has to be willing to pay for the learning.

Is the division of labor right?

A client presentation took me more than ten hours between first concept and final version. Rather than try to automate PowerPoint, I worked backward from the finished deck to find where the hours went. The model was strong at analyzing the data, surfacing patterns and generating valid directions. It was weak at knowing which insight mattered for this client, and its first set of charts partly repeated what the deck already said. Generation is not judgment, so I stopped asking whether AI could build the deck and redesigned the division of labor instead: the human frames the objective, audience and quality bar; AI organizes, analyzes and drafts; the human validates, prioritizes and owns the result. On a recent deck I used a model to move data and rebuild charts, then checked every recreated figure against the source. When I presented it, I said plainly that a model had done the transfer and that the numbers still needed to be verified by the people signing off. "We used AI" is not an acceptable excuse.

Does anyone reach for it next week?

Two groups on the same team, similar access, very different results. The analysts are younger and more comfortable with technology, and that didn't make them easier to move. Analyst value is legible through client coverage, calls, decks and hours, so workflow redesign can look less like real work; the jobs are individual enough that nobody's solution transfers cleanly; and as another analyst I can have opinions about how a peer should work without any standing to say so. Access, training and pressure from management together still don't add up to workflow redesign. The hardest part is usually not giving someone the tool, it's helping them notice that a task they've always done by hand contains a pattern that could change. "People aren't using it" is a symptom, not a diagnosis.

Who keeps the hours it returns?

If a task gives hours back, they can go into more of the same execution or into learning, research and better decisions. Nothing about the technology decides this; the organization does. As production gets cheaper, the human premium moves toward framing the problem, judgment, context, relationships and how fast someone learns. But where long visible hours signal commitment, working faster can cut against the individual even when the organization wants efficiency. A finished deck, a client call, a late night are easy to see; strategy, learning and thinking often produce no artifact at all. AI doesn't only compress production. It puts pressure on the status system built around knowledge work. And an open problem: if juniors learned the work by doing its repetitive parts, and those parts go away, what replaces that as apprenticeship?