S12 E16: Nikunj Bajaj, True Foundry

In this episode of Code Story, host Noah Laphart interviews Nikunj Bajaj, co-founder and CEO of True Foundry, a company building an enterprise-grade AI gateway and agentic deployment platform. Bajaj shares the origins of True Foundry, inspired by his time at Meta where he witnessed a vertically integrated stack for machine learning and generative AI. He explains how the company’s core mission emerged from the realization that enterprises were building fragmented, parallel stacks for software, ML, and AI—leading to inefficiency and complexity. True Foundry’s solution is a unified control plane—what they call an AI gateway—that connects, observes, and governs LLMs, MCPs, and agents across an organization’s infrastructure. The company spent over a year building a robust, Kubernetes-native foundation, betting early on the convergence of ML and infrastructure on Kubernetes, even as tools like Kubeflow declined. Bajaj emphasizes that the team is their proudest achievement, built on shared vision, ownership, and alignment. He reflects on a key mistake—underestimating the demand for an AI gateway—then pivoting quickly to become a market leader. Looking ahead, Bajaj envisions True Foundry evolving into a central compute orchestration platform, akin to how data warehouses like Snowflake centralized data, but for AI-driven compute. He also shares personal philosophies on perfection, first principles, and reputation as a founder. The episode is rich with insights on product strategy, team building, and the future of AI in enterprises. Bajaj stresses that the real challenge isn’t just building agents, but deploying them with confidence in production—ensuring governance, observability, and resilience. He warns against fragile, low-impact AI prototypes and calls for bolder bets where agents are embedded in critical business workflows. The discussion is punctuated by sponsor segments for .tech domains, The Build podcast, Unblocked, Mesmo, and BrainGrid—tools that support tech founders in branding, development, observability, and AI product management. Ultimately, the episode paints a picture of a founder deeply committed to foundational engineering, team culture, and long-term vision in the rapidly evolving AI landscape.