Luca Bianchi

This session shows how to build an eval-driven LLM routing system: harvest a production eval dataset, define accuracy KPIs using LLM-as-judge, set a non-negotiable accuracy floor as the practitioner's decision, benchmark candidate models, and generate a routing policy optimized for cost within that floor.

Health systems often lack the capability to account for comprehensive population health monitoring, yet collecting data like oxygenation, temperature, blood tests, and glucose can identify the signs of underlying conditions early. Many home devices are connected and capable of acquiring and monitoring a vast number of vital signs to track a person's health across many relevant metrics.