← Front page

The Twenty Minute VC (20VC) · Saturday, September 5, 2026

Open Source Models on Own Hardware: A Fraction of the Cost

Cliff Weitzman argued that running open-source models on self-owned hardware is significantly more cost-effective than using third-party token-based services. He noted that this approach allows for a cost per token that is a 'fraction of a fraction of a cent'.

personCliff WeitzmancompanyAzurecompanyAnthropic

The tape

2 quotes
The next thing that we found is actually if you run open source models for coding, you can pay anthropic. You're paying for all the tokens and the fact that you're doing the branded, right, the fable one.
Cliff Weitzman
Or you can run an open source model and instead of running it on a spot instance from Azure or whatever else, you run it on your own hardware. And then you're paying a fraction of a fraction of a cent per token.
Cliff Weitzman
Heard on The Twenty Minute VC (20VC) — “20VC: How to Build Your Own Data Center & Why Every Startup Should Do It | How ElevenLabs Leapfrogged Us: What I Learned | The AI Talent War: How Your Hiring Process Needs to Change with Cliff Weitzman, Speechify, published Saturday, September 5, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via Gemini audio transcription · $0.05
Open Source Models on Own Hardware: A Fraction of the Cost — Heardvine