Introduction to LLM
This page provides an easy-to-understand guide on LLMs (Large Language Models) from basics to applications for AI enthusiasts.
Chapter 13 — Autoscaling and Cold-Start Mitigation
Thirteenth post of the LLM Primer VI walkthrough. Why standard HPA fails for LLM serving, KEDA for TTFT-aware scaling, Knative scale-to-zero, and CRIU / CUDA graph caching for sub-5-second cold starts.
2026-05-05
Chapter 10 — The LLM Engine Layer
Tenth post of the LLM Primer VI walkthrough. vLLM as the safe default, TensorRT-LLM for peak NVIDIA-only throughput, SGLang for structured and agentic outputs, and TGI/Ollama for the rest.
2026-05-02
Chapter 9 — Speculative Decoding
Ninth post of the LLM Primer VI walkthrough. The draft-verify paradigm — EAGLE, Medusa, MTP, Lookahead, N-gram — and the verification bottleneck that decides real speedup.
2026-05-01
Chapter 8 — Next-Generation KV Cache Management
Eighth post of the LLM Primer VI walkthrough. PagedAttention, KV eviction algorithms (H2O, InfiniGen), and prefix caching for multi-turn conversations and multi-agent RAG.
2026-04-30
Chapter 7 — Advanced Batching Strategies
Seventh post of the LLM Primer VI walkthrough. Static vs dynamic vs continuous (in-flight) batching, iteration-level scheduling, and how a batch's slots actually progress on the GPU.
2026-04-29
Chapter 4 — Specialized AI Silicon and ASICs
Fourth post of the LLM Primer VI walkthrough. Groq LPUs, AWS Inferentia2, Google TPUs, and Intel Gaudi — where specialized silicon fits alongside general-purpose GPUs.
2026-04-26
Chapter 3 — Data Center GPUs for Generative AI
Third post of the LLM Primer VI walkthrough. The NVIDIA lineup (H100, H200, B200, L40S) vs AMD MI300X — and why HBM bandwidth matters more than FLOPs for decoding.
2026-04-25
LLM Primer VI — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book VI in the LLM Primer series — Scaling AI Systems. Why inference is the discipline that decides whether an LLM app survives real users, and the schedule for the sixteen posts that follow, April 23 through May 8.
2026-04-22
Chapter 8 — Optimizing Performance, Serving, and Cost
Eighth and final post of the LLM Primer V walkthrough. Semantic caching, dynamic model routing, and what actually happens inside the inference server — plus a look ahead to Volume VI on scaling.
2026-04-21
Chapter 14 — Practical Knowledge for Engineers
Twelfth post — the closing chapter of the LLM Primer II walkthrough. How to keep deepening your understanding after the book ends, the tools and libraries that turn the math into shipping work, and the bridge to the other books in the LLM Primer series.
2026-03-16