Open Models vs Frontier Models: Who Actually Wins? | The $100K Token Budget Every Engineer Will Need
20VC with Harry Stebbings · 1:11:53 · 1 weeks ago
Successful enterprise AI implementation relies on avoiding the high cost of pre-training models from scratch, favoring a strategy that fine-tunes existing open-weights models while embedding expert teams directly into client organizations to ensure complex deployments actually work.
- Model strategy — Sierra avoids the capital expense of pre-training foundation models, choosing instead to fine-tune open-weights models to maintain efficiency while retaining control over the final product .
- Frontier demand — High-complexity fields like law, science, and coding will drive persistent demand for top-tier intelligence, even as cheaper models effectively handle standard business tasks .
- Token economics — Spending on AI tokens will likely rise toward 20% of engineering budgets, as reasoning-heavy models require more computing power and hardware supply remains constrained .
- Implementation approach — Success in large organizations requires "forward deployed" teams that act as partners to integrate AI into complex, existing technology stacks .
- Internal operations — The company relies on its own internal AI agent, Pinecone, to handle knowledge management, strategic planning, and administrative reviews .
- Hiring process — Engineering interviews have shifted to AI-native tests where candidates must use agents to build functional applications during the evaluation .