Evals for AI Engineers
The O'Reilly cover of Evals for AI Engineers, illustrated with two reddish-brown animals on a branch.
Published by O'Reilly

Evals for
AI Engineers

Systematically measuring and improving AI applications

By Shreya Shankar & Hamel Husain

How do you know if your AI application is working? This book shows you how to find its failures and build evaluations that help you improve it.

A practical guide to error analysis, building automated evaluators, and monitoring AI in production. Build a continuous improvement loop that makes your AI more reliable and less costly to run.

Step 1: Order the book

Amazon Barnes & Noble Bookshop.org

Choose your retailer for release and shipping dates.

Step 2: Claim your bonus

Get an exclusive 29% discount off our evals course, plus a live reader Q&A with Hamel.

The discount saves more than $1,200, over 10× the book’s price, through January 31, 2027. The Q&A is Wednesday, December 16, 2026, at 8 a.m. PT / 11 a.m. ET, with a recording if you can’t make it. Claiming your bonus saves your seat.

Claim your bonus

Have your receipt ready.

For your team

Team packs of 25 or more copies

Rolling out evals across your team? Order 25 or more copies at 40% off and get a live Team Session with Hamel for everyone on your order, plus 30% or more off the course.

See team packs
AI Evals for Engineers & PMs with Hamel Husain and Shreya Shankar. Course card showing the instructors, a 4.7 rating from 887 reviews, and 4,500+ alumni.

Learn with us

AI Evals for Engineers & PMs

The book teaches the basics at your own pace. Our live course helps you master them through hands-on practice and personalized feedback from us. We refresh what we teach as new methods emerge.

  • 8+ hours of live office hours for feedback on your projects.
  • Lifetime access to recordings and course materials.
  • Unlimited retakes of future cohorts, including office hours.
  • Ongoing access to our private Discord community.

Buy the book first for a better discount of 29% off

See the course on Maven without the book discount