---
author: "Umesh Malik"
canonical: "https://umesh-malik.com/blog/tag/agentic-web"
description: "Explore articles tagged with Agentic Web by Umesh Malik — AI Engineer, LLM & GenAI Developer. Learn Agentic Web best practices, practical tips, and in-depth guides."
title: "Umesh Malik's Blog - Agentic Web Articles | Agentic Web Tutorials"
tokens: 553
generator: "scripts/generate-page-markdown.mjs"
---

[← Back to Blog](https://umesh-malik.com/blog)

# Agentic Web

4 articles

 [![Verifying AI crawler identity by matching source IPs against published CIDR lists instead of trusting the User-Agent header](https://umesh-malik.com/blog/verify-ai-crawler-ips-not-user-agents-cover.png)

AI Security • Aug 13, 2026

### How to Verify AI Crawler IPs: 3 Lists Are Over a Year Stale

Verify AI crawler IPs instead of trusting the User-Agent: the CIDR check for ClaudeBot and GPTBot, and the three published lists that are over a year stale.

8 min read

Read more →](https://umesh-malik.com/blog/verify-ai-crawler-ips-not-user-agents)

 [![The four agentic web layers — readable, discoverable, callable, payable — mapped to concrete URLs on a static site](https://umesh-malik.com/blog/make-your-site-agent-readable-cover.png)

Web Engineering • Aug 7, 2026

### How to Make Your Site Agent-Readable: 4 Layers, One Worker

Make your site agent-readable in four layers — readable, discoverable, callable, payable. Three are build-time files; only /mcp needs a Worker.

10 min read

Read more →](https://umesh-malik.com/blog/make-your-site-agent-readable)

 [![Ads for AI agents: TIME serves markdown with sponsored FAQ blocks to AI crawlers and HTML to humans](https://umesh-malik.com/blog/ads-for-ai-agents-time-markdown-crawlers-cover.png)

AI Engineering • Aug 6, 2026

### Ads for AI Agents: TIME Serves Crawlers a Different Site

Ads for AI agents are live. TIME serves crawlers a 42 KB markdown site with sponsored blocks; humans and Googlebot get 1.2 MB of HTML. I measured all of it.

10 min read

Read more →](https://umesh-malik.com/blog/ads-for-ai-agents-time-markdown-crawlers)

 [![Diagram of an AI agent paying an API over the x402 HTTP 402 protocol using a Cloudflare Virtual Wallet](https://umesh-malik.com/blog/cloudflare-wallets-x402-agent-payments-cover.png)

AI Engineering • Aug 4, 2026

### Cloudflare Wallets and x402: How AI Agents Pay for APIs

Cloudflare Wallets and x402 explained: how AI agents get a spending identity, how HTTP 402 payments work, and what breaks when your agent holds a budget.

10 min read

Read more →](https://umesh-malik.com/blog/cloudflare-wallets-x402-agent-payments)