← Front page

Capital Allocators · Monday, September 14, 2026

AI Can Make Mistakes with Numbers and Complexity, Requiring Human Scrubbing

Abby Barlow cautions that while AI tools are powerful, they are not infallible, especially when dealing with numbers and complex data. She emphasizes the need for thorough human review, comparing it to a junior analyst's work, and shares an anecdote about Claude double-counting commitments in a pacing model.

The tape

3 quotes
“It does make mistakes. Especially when you're dealing with numbers and complexity. It gets me to a solid first draft. I need to thoroughly scrub it. It's like a junior analyst would do.”
“You would never take something an analyst would give you the first time and be like, this is perfect. I'm showing it to the family. It was double counting some of our commitments in our pacing model. I was building. It's hard to catch that stuff.”
“I've gotten in a habit where I will ask it at the end of any deliverable. Go back to the beginning of this conversation and what we were trying to accomplish. Review the deliverable. Triple check all the numbers again. Find your own errors. It will be like, oh, I missed these three things.”
Heard on Capital Allocators — “AI in the Investment Office – Abby Barlow, Laura Hill, Brian Sugrue, Jenny Heller, John Lawrence, Matt Bank, Kristin Kallergis Rowland, Jon Webster (EP.515)”, published Monday, September 14, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via Gemini audio transcription · $0.06