979: Agentic Data Management and the Future of Enterprise AI, with Rohit Choudhary

In this episode of Super Data Science, host Jon Krohn interviews Rohit Choudhary, founder and CEO of Excel Data, a Bay Area startup pioneering agentic data management (ADM). Choudhary shares how Excel Data evolved from being a pioneer in data observability—coining the term in 2018—to building the industry’s first agentic data management platform. He explains that enterprise data is now growing at 4–5x annually, accelerating to nearly 10x, driven by AI agents generating massive data activity. The ADM platform enables organizations to fix data issues in real time as data flows through pipelines, drastically reducing the cost of remediation—up to 1,000 times cheaper than fixing data post-consumption. Choudhary emphasizes that AI-ready data must be technically accurate, contextually compliant with business policies, and verifiable across complex workflows. He also discusses the future of data governance, shifting from static compliance to active, real-time, agent-enabled operations, and predicts the decline of the CAIO role as AI becomes embedded across all business functions. The episode concludes with insights on career evolution in the AI era, where clarity of thought and domain expertise outweigh coding skills, and the importance of decentralized, AI-native data architectures. Key takeaways include: (1) Fixing data at ingestion is 1,000x cheaper than post-consumption remediation; (2) Agentic data management enables real-time, automated data quality and governance; (3) Enterprise data growth is accelerating to near 10x per year due to AI agent activity; (4) The most valuable professionals in the AI era will be those with clear thinking, deep domain knowledge, and curiosity; (5) Data governance must evolve from static compliance to active, operational intelligence; (6) The CAIO role is likely to fade as AI becomes woven into every business function; (7) SLMs (small language models) will be essential for privacy, speed, and cost efficiency in enterprise AI; (8) Success in AI-driven enterprises will depend on mission-driven teams with craftsmanship, humility, and a beginner’s mindset.