AI Security •
How to Harden vLLM Inference: CVE-2025-9141 Defense Guide
How to harden vLLM inference against token exploits. CVE-2025-9141 let models run code via eval(). Separate GPU hosts from parsers.
9 min read
Read more →
LLM Engineering •
ChatGPT Search Optimization After the Site-Scoping Shift
ChatGPT search optimization changed when 17% of queries started scoping to specific sites. What the GPT-5.6 shift means and how to get cited.
7 min read
Read more →
AI Engineering •
Agent context compaction: keep what the 150K cutoff drops
Agent context compaction drops every block before the summary at 150K tokens. What survives, what instructions silently replaces, and the usage field that lies.
9 min read
Read more →
LLM Engineering •
How to Test an LLM's Knowledge Cutoff: Opus 5's May Claim Falls Short
Here's how to test an LLM's knowledge cutoff with three reproducible probes — the method showing Opus 5 claims May 2026 but answers like January 2026.
7 min read
Read more →
LLM Engineering •
vLLM throughput tuning: configure these four flags, not a bigger GPU
vLLM throughput tuning starts with KV cache blocks, not a bigger GPU. The four flags that decide your tokens/sec, and the one that quietly backfires.
10 min read
Read more →
AI Engineering •
Run agent tool calls in parallel: 10 turns become 2 DAG levels
Run agent tool calls in parallel by swapping the loop for a DAG planner: ten round trips become two levels, plus the cap, budget and critic on top.
10 min read
Read more →
LLM Engineering •
Reinforcement Fine-Tuning: When a 4B Model Beats GPT-5.6
Reinforcement fine-tuning let a 4B open model match GPT-5.6 Sol on retrieval at 100x lower cost. How RFT works, and when it beats prompting a frontier LLM.
10 min read
Read more →
AI Engineering •
Agent Harness Design: Why an ARC-AGI-3 Score Tripled
Agent harness design decided a benchmark: OpenAI's ARC-AGI-3 score went 13.3% → 38.3% with zero model changes. What that means for your agent loop.
11 min read
Read more →
AI Security •
LLM Abuse Detection: What OpenAI's Scam Ban Reveals
LLM abuse detection failed at the message level and worked at the account level. OpenAI's Cambodia scam ban shows which signal actually catches misuse.
11 min read
Read more →
LLM Engineering •
LLM Eval Framework: Grade Prompts, Models and Harnesses
An LLM eval framework turns vibes into scores. How smevals structures tasks, configs, runners and graders — and how to ship your first eval today.
10 min read
Read more →
LLM Engineering •
Run 70B LLM on 4GB GPU: AirLLM's Real Tradeoff
Run 70B LLM on 4GB GPU hardware with AirLLM's layer-by-layer inference. The VRAM math is real — you just pay for it in disk bandwidth. The honest tradeoff.
11 min read
Read more →
AI Engineering •
Build a RAG Chatbot in Next.js: Retrieval, Streaming & Citations (2026)
Build a RAG chatbot in Next.js with the AI SDK: embed the query, search pgvector, stream a grounded answer with citations, and stop hallucinations.
8 min read
Read more →
AI Engineering •
Vercel AI SDK in Production: Streaming, Tool-Calling & the Gotchas Nobody Tells You (2026)
Vercel AI SDK in production: streaming, tool-calling, aborting generations, error retry UX, rate limiting, and cost control — the layer every tutorial skips.
9 min read
Read more →
AI Engineering •
Why 77% of Autonomous AI Agents Never Reach Production (2026)
Only 23% of autonomous AI agents reach production in 2026. The demo-to-production gap, why agents fail, and the playbook the winners actually use.
9 min read
Read more →
AI Engineering •
Build a RAG Pipeline From Scratch: Production Patterns That Matter
Build a RAG pipeline from scratch: chunking, embeddings, retrieval, reranking, grounded generation, and the production patterns that decide whether it works.
7 min read
Read more →
AI Engineering •
How to Build an MCP Server: A Step-by-Step Guide (2026)
How to build an MCP server, step by step: JSON-RPC 2.0, the Streamable HTTP transport, typed tools, and agent discovery — from a real one I shipped.
9 min read
Read more →
AI Engineering •
RAG vs Fine-Tuning for LLMs in 2026: A Production Decision Framework With Real Tradeoffs
RAG vs fine-tuning for LLMs in 2026: a practical decision framework covering architecture tradeoffs, cost, latency, and when to use each in production.
6 min read
Read more →