Chammarychammary

Decagon’s Playbook for Building Enterprise AI Applications

a16z · 1:20:15 · 4 days ago

Decagon builds enterprise AI by prioritizing open-source models for latency, cost, and control, while utilizing "forward-deployed" engineering to productize workflows rather than relying on permanent manual consulting.

  • Model selection — 90% of operational workflows run on open-source models to optimize response times and maintain strict control over model output .

  • Optimization — Engineers tune smaller models for individual tasks, reaching performance levels exceeding general-purpose frontier models while simultaneously reducing operational costs .

  • Architecture — The platform utilizes "glass box" designs where companies retain visibility into agent logic, contrasting with "black box" competitors that mask internal operations .

  • Scaling — An agent called "Duet" automates the maintenance of other agents by writing procedures, running tests, and monitoring performance across millions of interactions .

  • Development model — Forward-deployed engineering serves as a temporary phase to learn operational workflows and build product features, rather than becoming a permanent consulting business .

  • Employment trends — Automation often triggers the Jevons Paradox, where lower costs drive companies to expand the accessibility and volume of support rather than simply cutting headcount .

  • How does training smaller models influence operational latency?

  • Does implementing autonomous agents typically result in reduced headcount or expanded service offerings?