---
author: "Umesh Malik"
canonical: "https://umesh-malik.com/blog/tag/model-architecture"
description: "Explore articles tagged with Model Architecture by Umesh Malik — AI Engineer, LLM & GenAI Developer. Learn Model Architecture best practices, practical tips, and in-depth guides."
title: "Umesh Malik's Blog - Model Architecture Articles | Model Architecture Tutorials"
tokens: 168
generator: "scripts/generate-page-markdown.mjs"
---

[← Back to Blog](https://umesh-malik.com/blog)

# Model Architecture

1 article

 [![Editorial cover comparing a 44-block transformer to a 22-block looped transformer applied twice, with an 18 percent training compute reduction stat](https://umesh-malik.com/blog/looped-transformers-parameter-compute-tradeoff-cover.png)

LLM Engineering • Sep 10, 2026

### How to Decide: Loop Transformer Blocks or Add More Layers

Loop transformer blocks or add more layers? Reusing weights cuts training compute 6.8-18% at equal loss, but forward passes and KV cache never shrink.

10 min read

Read more →](https://umesh-malik.com/blog/looped-transformers-parameter-compute-tradeoff)