---
author: "Umesh Malik"
canonical: "https://umesh-malik.com/blog/tag/evals"
description: "Explore articles tagged with Evals by Umesh Malik — AI Engineer, LLM & GenAI Developer. Learn Evals best practices, practical tips, and in-depth guides."
title: "Umesh Malik's Blog - Evals Articles | Evals Tutorials"
tokens: 425
generator: "scripts/generate-page-markdown.mjs"
---

[← Back to Blog](https://umesh-malik.com/blog)

# Evals

3 articles

 [![A claimed 1.4x speedup collapsing to 1.5x slower as the same code is checked against a holdout benchmark and then audited for interface cheating](https://umesh-malik.com/blog/verify-ai-agent-benchmark-claims-cover.png)

AI Coding Agents & DX • Aug 19, 2026

### How to verify AI-generated benchmark claims: 1.4x to 1.5x slower

How to verify AI-generated benchmark claims: an LLM agent's regex engine beat Rust's regex crate by 1.4x on rebar, then lost 10x on a holdout it never saw.

9 min read

Read more →](https://umesh-malik.com/blog/verify-ai-agent-benchmark-claims)

 [![Diagram of an LLM eval framework pipeline: tasks and configs produce runs, graders apply checks to produce grades](https://umesh-malik.com/blog/llm-eval-framework-smevals-cover.png)

LLM Engineering • Aug 4, 2026

### LLM Eval Framework: Grade Prompts, Models and Harnesses

An LLM eval framework turns vibes into scores. How smevals structures tasks, configs, runners and graders — and how to ship your first eval today.

10 min read

Read more →](https://umesh-malik.com/blog/llm-eval-framework-smevals)

 [![Production-grade AI agents — the funnel from 353,000 course registrations down to 6,000 shipped agent projects](https://umesh-malik.com/blog/production-grade-ai-agents-vibe-to-live-gap-cover.png)

AI Engineering • Aug 4, 2026

### Production-Grade AI Agents: The Vibe-to-Live Gap

Production-grade AI agents need more than a working demo. 353,000 signed up to learn agents; 6,000 shipped a capstone. Here's exactly what closes the gap.

11 min read

Read more →](https://umesh-malik.com/blog/production-grade-ai-agents-vibe-to-live-gap)
