Introduction to LLM
This page provides an easy-to-understand guide on LLMs (Large Language Models) from basics to applications for AI enthusiasts.
Chapter 11 — The Platform and Orchestration Layer
Eleventh post of the LLM Primer VI walkthrough. Engine vs platform — Ray Serve, KServe, BentoML, and NVIDIA Triton — and where each fits in a multi-model pipeline.
2026-05-03
Chapter 10 — The LLM Engine Layer
Tenth post of the LLM Primer VI walkthrough. vLLM as the safe default, TensorRT-LLM for peak NVIDIA-only throughput, SGLang for structured and agentic outputs, and TGI/Ollama for the rest.
2026-05-02
Chapter 9 — Speculative Decoding
Ninth post of the LLM Primer VI walkthrough. The draft-verify paradigm — EAGLE, Medusa, MTP, Lookahead, N-gram — and the verification bottleneck that decides real speedup.
2026-05-01
Chapter 7 — Advanced Batching Strategies
Seventh post of the LLM Primer VI walkthrough. Static vs dynamic vs continuous (in-flight) batching, iteration-level scheduling, and how a batch's slots actually progress on the GPU.
2026-04-29
LLM Primer VI — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book VI in the LLM Primer series — Scaling AI Systems. Why inference is the discipline that decides whether an LLM app survives real users, and the schedule for the sixteen posts that follow, April 23 through May 8.
2026-04-22
Chapter 13 — Frameworks and Cloud Integration
Fourteenth post of the LLM Primer IV walkthrough. Strands with Bedrock, the AWS state-layer pattern, the Microsoft Agent Framework, LangChain, Semantic Kernel — and the three production integration shapes teams keep arriving at independently.
2026-04-11
Chapter 14 — Practical Knowledge for Engineers
Twelfth post — the closing chapter of the LLM Primer II walkthrough. How to keep deepening your understanding after the book ends, the tools and libraries that turn the math into shipping work, and the bridge to the other books in the LLM Primer series.
2026-03-16