Ep. #91, Every Failure Becomes an Eval with Janaki Vivrekar
Ken Rimple and Jessica Kerr sit down with Janaki Vivrekar, who shares how Amplitude is building AI-powered analytics agents, why evaluation frameworks are becoming essential to AI product development, and how teams can use observability techniques to improve agent performance over time.
By: Ken Rimple
Details
On episode 91 of o11ycast, Ken Rimple and Jessica Kerr sit down with Janaki Vivrekar of Amplitude.
Janaki shares how Amplitude is building AI-powered analytics agents, why evaluation frameworks are becoming essential to AI product development, and how teams can use observability techniques to improve agent performance over time. The conversation explores eval-driven development, production feedback loops, and the challenges of helping AI systems reason about complex business data.