Evals London

Evaluating AI applications, not just models.

A London meetup and community for people who build AI-powered products. Model benchmarks on leaderboards are interesting, but how do you evaluate your specific RAG pipeline in production?

Sister meetup of Evals.cz, which has run four Prague editions since February 2026. More

What we tackle

🔍

RAG system quality

Evaluating retrieval quality and end-to-end RAG pipelines in production

⚠️

Production regressions

How to catch and fix problems in deployed AI systems

👥

Human-in-the-loop

Evaluation approaches that combine human expertise with automation

⚙️

Development lifecycle

Integrating evals into development and CI/CD pipelines

Who it's for

ML/AI engineers

You deploy and monitor models in production

Backend developers

You integrate LLMs or RAG into an existing product

Data scientists

You measure and improve the performance of AI systems

Product managers

You need to understand the quality of AI features

AI researchers

You study the reliability and safety of AI

Beginners welcome

Practical interest and curiosity are all you need

Meetup format

LocationDawn Capital, London
WhenWednesday 11 November 2026, 18:00–21:30
FormatKeynote, one talk + discussion tables
LanguageEnglish
"What broke in production and how we fixed it"— no sales pitches

Partners

Want to support a future edition? Partner with us

Registration open

Edition #1

Wed 11 Nov at Dawn Capital

Registration is open on Luma. The line-up is being put together right now, with speakers announced as each one confirms. Grab your spot early, since the room holds about 100.

Wed 11 Nov 202618:00–21:30Dawn CapitalLondon
Register on Luma
A taster

What we'll dig into

  • Error analysis & failure taxonomies
  • Assertion-based evaluation
  • LLM-as-Judge frameworks
  • RAG-specific metrics
  • Evaluating agents & tool use
  • Human evaluation & annotation design
  • Wiring evals into CI/CD