Pierre Burgy
Events1
Conferences1
Talks1
Years active2025
Appearances by year
- AI Engineer (World's Fair, Summit and regional editions)
Talks
| Date | Event | Conference | Role | Title | Links |
|---|---|---|---|---|---|
| Sep 23, 2025 | AI Engineer Paris 2025 | AI Engineer (World's Fair, Summit and regional editions) | speaker | Vibe > Benchmarks: Rethinking AI Evaluation for the Real WorldAI evaluations are broken. Benchmark scores look good on paper, but they rarely translate into user value. What matters isn’t how your model performs on curated…Show lessAI evaluations are broken. Benchmark scores look good on paper, but they rarely translate into user value. What matters isn’t how your model performs on curated test sets—it’s what your users actually use. I’ll walk through why most AI evals are a distraction, how we built “vibe benchmarks” by watching usage patterns, and how qualitative feedback loops are often more scalable than gold labels. |
Frequent co-speakers
No one else spoke at two or more of the same events.
Speakers with the same name are merged into one entry, so this page may combine more than one person. Affiliations are shown as each conference listed them.