Introduction to LLM
This page provides an easy-to-understand guide on LLMs (Large Language Models) from basics to applications for AI enthusiasts.
Chapter 13 — Regulatory Landscape
Thirteenth post of the LLM Primer VII walkthrough. The EU AI Act (Regulation 2024/1689), US EO 14179, Colorado AI Act, NIST AI RMF + GenAI Profile, and ISO/IEC 42001 as the compliance skeleton.
2026-05-22
Chapter 12 — Access Control and Identity
Twelfth post of the LLM Primer VII walkthrough. OAuth 2.0 + PKCE, ABAC vs ReBAC (Zanzibar), multi-tenant isolation, and token-bucket rate limits for LLM APIs.
2026-05-21
Chapter 5 — Input Validation and Output Filtering
Fifth post of the LLM Primer VII walkthrough. Input sanitization, structured guardrails (NeMo, Llama Guard 3, Lakera, Bedrock), and red teaming with Garak, PyRIT, and promptfoo.
2026-05-14
Chapter 3 — Data Security and Privacy
Third post of the LLM Primer VII walkthrough. Training-data risks, memorization and extraction (Carlini et al., Nasr et al.), and the encryption, isolation, and retention disciplines that keep sensitive prompts contained.
2026-05-12
Chapter 2 — Threat Modeling for LLM Systems
Second post of the LLM Primer VII walkthrough. Adapting STRIDE, PASTA, and attack trees to LLM systems — model, prompt, data, and infrastructure as assets, and MITRE ATLAS as the LLM-specific adversary catalog.
2026-05-11
Chapter 1 — Why AI Security Is Different
First post of the LLM Primer VII walkthrough. Why LLM security is structurally different from traditional security — the collapsed code/data boundary, the probabilistic core, and the OWASP LLM Top 10 as a working checklist.
2026-05-10
LLM Primer VII — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book VII in the LLM Primer series — AI Security. Why in LLM systems code and data are the same string, and the schedule for the seventeen posts that follow, May 10 through May 26. This is the series finale.
2026-05-09
Chapter 15 — Serverless APIs vs Dedicated Infrastructure
Fifteenth post of the LLM Primer VI walkthrough. The breakeven math between serverless APIs and dedicated infrastructure, the hidden platform-engineering overhead each side takes on, and microVM sandboxes for agent code execution.
2026-05-07
Chapter 13 — Autoscaling and Cold-Start Mitigation
Thirteenth post of the LLM Primer VI walkthrough. Why standard HPA fails for LLM serving, KEDA for TTFT-aware scaling, Knative scale-to-zero, and CRIU / CUDA graph caching for sub-5-second cold starts.
2026-05-05
Chapter 9 — Speculative Decoding
Ninth post of the LLM Primer VI walkthrough. The draft-verify paradigm — EAGLE, Medusa, MTP, Lookahead, N-gram — and the verification bottleneck that decides real speedup.
2026-05-01
Chapter 8 — Next-Generation KV Cache Management
Eighth post of the LLM Primer VI walkthrough. PagedAttention, KV eviction algorithms (H2O, InfiniGen), and prefix caching for multi-turn conversations and multi-agent RAG.
2026-04-30
Chapter 4 — Specialized AI Silicon and ASICs
Fourth post of the LLM Primer VI walkthrough. Groq LPUs, AWS Inferentia2, Google TPUs, and Intel Gaudi — where specialized silicon fits alongside general-purpose GPUs.
2026-04-26
Chapter 3 — Data Center GPUs for Generative AI
Third post of the LLM Primer VI walkthrough. The NVIDIA lineup (H100, H200, B200, L40S) vs AMD MI300X — and why HBM bandwidth matters more than FLOPs for decoding.
2026-04-25
Chapter 2 — The KV Cache Challenge
Second post of the LLM Primer VI walkthrough. The KV cache formula, the attention-variant trade-offs (MHA vs GQA vs MQA), and the memory-fragmentation problem PagedAttention solves.
2026-04-24
Chapter 1 — The Mechanics of Token Generation
First post of the LLM Primer VI walkthrough. The autoregressive bottleneck, the prefill/decode split, and why a high-end GPU is 99.7% idle while serving a single user.
2026-04-23
LLM Primer VI — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book VI in the LLM Primer series — Scaling AI Systems. Why inference is the discipline that decides whether an LLM app survives real users, and the schedule for the sixteen posts that follow, April 23 through May 8.
2026-04-22
Chapter 3 — Retrieval-Augmented Generation
Third post of the LLM Primer V walkthrough. The RAG pipeline end to end — chunking, hybrid retrieval, query transformation, multimodal, and text-to-SQL — and where RAG fits versus fine-tuning and long context.
2026-04-16
Chapter 2 — Foundation Models & Prompt Engineering
Second post of the LLM Primer V walkthrough. Model tiering, sampling parameters, defensive prompt patterns, and structured outputs as engineering surfaces — the layer just inside the deterministic wrapper.
2026-04-15
Chapter 1 — The Discipline of AI Engineering
First post of the LLM Primer V walkthrough. Why the demo works and production doesn't — the deterministic wrapper around the probabilistic core, and the five pillars (reliability, quality, performance, cost, evolution) that keep the wrapper honest.
2026-04-14
LLM Primer V — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book V in the LLM Primer series — Building Real-World LLM Applications. Why AI engineering is a discipline of its own, who this book is for, and the schedule for the eight posts that follow, April 14 through April 21.
2026-04-13
Chapter 14 — Benchmarking, Testing, and Performance
Fifteenth and final post of the LLM Primer IV walkthrough. The MCP-Universe Benchmark on real servers, the two systemic failure modes it exposed, the ten-times throughput gap between session-per-request and shared session pools, and the bridge to Volume V.
2026-04-12
Chapter 5 — Transport Protocols and Discovery
Fifth post of the LLM Primer IV walkthrough. The three transports MCP supports, the .well-known discovery layer with Server Cards, and the boring operational concerns — CORS, origin validation, caching — that decide whether a server is a cooperative network citizen or a liability.
2026-04-03
Chapter 3 — Server Primitives: Exposing Context and Capabilities
Third post of the LLM Primer IV walkthrough. The three nouns an MCP server can offer — Resources (read state), Prompts (reusable scaffolding), Tools (write actions) — their schemas, their lifecycles, their error models, and the discipline of choosing the right primitive.
2026-04-01
Chapter 2 — Unveiling the Model Context Protocol (MCP)
Second post of the LLM Primer IV walkthrough. What MCP actually standardizes, the three-role split of Host, Client, and Server, why dynamic discovery and bidirectional messaging differ from REST in the cases that matter, and the session lifecycle that opens with capability negotiation.
2026-03-31
LLM Primer IV — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book IV in the LLM Primer series — Designing AI Cognition with MCP. Why agents need a protocol layer to scale past demoware, who this book is for, and the schedule for the fourteen posts that follow, March 30 through April 12.
2026-03-29
Chapter 11 — Continuous Updates and Pipeline Optimization
Eleventh and final post of the LLM Primer III walkthrough. CDC and incremental indexing keep the corpus fresh, semantic caching and model tiering keep latency down, and a four-stage feedback loop closes the gap between what production tells the team and what the team actually changes — plus a bridge to Volume IV on Model Context Protocol.
2026-03-28
Chapter 10 — Leading Evaluation Frameworks
Tenth post of the LLM Primer III walkthrough. A field guide to the frameworks that turn the Evaluation Triad into something a team can actually run — RAGAS, TruLens, DeepEval on one side, Braintrust, LangSmith, Phoenix, Galileo, Opik on the other, and the Evaluation Gap none of them has yet closed.
2026-03-27
Chapter 9 — The RAG Evaluation Triad
Ninth post of the LLM Primer III walkthrough. A RAG system can fail in three different places and the failures look identical from the outside — the Evaluation Triad of Context Relevance, Groundedness, and Answer Relevance is the small vocabulary that prevents fixing one bug while measuring another.
2026-03-26
Chapter 8 — Data Anonymization in the RAG Pipeline
Eighth post of the LLM Primer III walkthrough. Pre-generation versus post-generation anonymisation, the three technique families — masking, synthetic replacement, differential privacy — and the utility-privacy tradeoff that determines whether the system remains useful at all.
2026-03-25
Chapter 7 — Implementing Access Control
Seventh post of the LLM Primer III walkthrough. Document-level ACLs as the foundation, RBAC with Microsoft Purview sensitivity labels, ReBAC with Zanzibar and SpiceDB, and the pre-filter versus post-filter discipline that runs underneath all of them.
2026-03-24
Chapter 6 — RAG Threat Models and Vulnerabilities
Sixth post of the LLM Primer III walkthrough. The expanded attack surface of retrieval — corpus poisoning, adversarial chunks, indirect prompt injection, embedding inversion, and the confused-deputy problem in agentic RAG. Concrete attacks, each demonstrated, each reproducible.
2026-03-23
Chapter 5 — Architecting the Retrieval Pipeline
Fifth post of the LLM Primer III walkthrough. Why a single vector search is not a pipeline — hybrid retrieval, reciprocal rank fusion, cross-encoder reranking, and query-side rewriting and HyDE — assembled into the production architecture that mature RAG systems converge on.
2026-03-22
Chapter 4 — Selecting the Right Vector Database
Fourth post of the LLM Primer III walkthrough. The architectural split between purpose-built vector databases and Postgres-style extensions, the managed leaders (Pinecone, Vertex), the open-source field (Qdrant, Milvus, Weaviate), the embedded options, and the three operational axes — residency, ops, cost — that decide the real choice.
2026-03-21
Chapter 3 — Advanced Chunking Frameworks
Third post of the LLM Primer III walkthrough. The chunking spectrum from fixed-size to structure-aware, the overlap myth, the context cliff that destroys retrieval quietly, and the contextual-retrieval and late-chunking techniques that have reshaped the frontier.
2026-03-20
Chapter 2 — Intelligent Document Parsing
Second post of the LLM Primer III walkthrough. Why a PDF is not a text file, what layout-aware parsers actually preserve, the current tool landscape (LlamaParse, Docling, Unstructured, Marker-PDF, Firecrawl, DeepSeek-OCR), and the multimodal track that retrieves over page images directly.
2026-03-19
Chapter 1 — The Evolution of RAG Architecture
First post of the LLM Primer III walkthrough. The four architectural postures of RAG — Naive, Advanced, Modular, Agentic — read as a story about handing more agency to the LLM one decision at a time, and the honest answer to when fine-tuning is the better tool than retrieval.
2026-03-18
LLM Primer III — Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book III in the LLM Primer series — Enhancing Enterprise AI with RAG. Why retrieval-augmented generation looks simple from the outside and is a stack of disciplines underneath, who this book is for, and the schedule for the eleven posts that follow, March 18 through March 28.
2026-03-17
Chapter 14 — Practical Knowledge for Engineers
Twelfth post — the closing chapter of the LLM Primer II walkthrough. How to keep deepening your understanding after the book ends, the tools and libraries that turn the math into shipping work, and the bridge to the other books in the LLM Primer series.
2026-03-16
Chapter 13 — Limitations, Risks, and Open Challenges
Eleventh post of the LLM Primer II walkthrough. The honest chapter — the compute and energy ceilings that constrain the field, the biases that scale with the data, and the ethical and societal questions that math alone cannot answer.
2026-03-15
Chapter 12 — Real-World Applications of LLMs
Twelfth post of the LLM Primer II walkthrough. Text generation, summarization, QA, translation, reasoning — and the constrained decoding, agent loops, and multimodal generalization that turn one next-token machine into a dozen kinds of product.
2026-03-14
Chapter 11 — Evaluation, Calibration, and Inference
Eleventh post of the LLM Primer II walkthrough. Perplexity, calibration, the error bars that every benchmark score should carry, and the mathematics of measuring hallucination — the chapter where we ask how anyone can measure a machine that can say anything.
2026-03-13
Chapter 4 — Attention: The Core Mechanism
Fourth post of the LLM Primer II walkthrough. Self-attention derived from intuition, the geometry of queries/keys/values, multi-head structure and normalization, softmax in detail with its temperature knob, and a striking final move: attention seen as a kernel method.
2026-03-06
Chapter 3 — Mathematical Tools for Language Models
Third post of the LLM Primer II walkthrough. The probability and statistics you actually need for language modeling, the slice of linear algebra that matters, and embeddings as the first place those two tools meet inside an LLM.
2026-03-05
Chapter 2 — LLMs in Context: Concepts and Background
Second post of the LLM Primer II walkthrough. What an LLM actually is, the three things "pretraining, parameters, scale" really stand for, the unusual nature of language as a data source, and why the transformer rewrote the field in a single year.
2026-03-04
LLM Primer II — Language Models Through Mathematics: Series Introduction & Index
Kicking off the chapter-by-chapter walkthrough of Book II in the LLM Primer series — Language Models Through Mathematics. How the book is organized, what each chapter delivers, and the schedule for the fourteen posts that follow, March 3 through March 16.
2026-03-02
Chapter 4 — The Transformer Architecture: Inside the Engine of Modern AI
Chapter 4 of the LLM Primer I series. A tour of the Transformer block — how self-attention, positional encoding, and stacked layers combine to produce the architecture every modern LLM is built on. Includes a clear explanation of why scaling Transformers works, and what it costs.
2026-02-21
Chapter 3 — Neural Networks for Language: From RNNs to Self-Attention
Chapter 3 of the LLM Primer I series. Why feedforward networks couldn't handle language, how RNNs hit a wall, and what attention changed. A clean conceptual progression through the three neural-network shapes that defined modern NLP — without the math anxiety.
2026-02-20
Chapter 2 — Probability, Tokens, and Text: The Game of Next-Word Guessing
Chapter 2 of the LLM Primer I series. How LLMs convert text into tokens, why language modeling is fundamentally a probability problem, and how the old n-gram approach gave way to neural models that can generalize. Includes plain-English explanations of perplexity and why every token boundary matters.
2026-02-19
Chapter 1 — What Is a Large Language Model? (Beyond the Headlines)
Chapter 1 of the LLM Primer I series. We unpack what 'Large,' 'Language,' and 'Model' actually mean, walk through the move from rule-based systems to neural networks, and address the three biggest misconceptions about how modern LLMs work. A clear, accessible foundation for everything that follows.
2026-02-18
A Chapter-by-Chapter Walkthrough of LLM Primer I — Series Introduction & Index
Introduction and index for the twelve-part chapter-by-chapter walkthrough of LLM Primer I: How Generative AI Works. One post per day, Feb 18 through March 1, 2026. Read them in order or pick the chapter that matters most to you. All twelve are listed and linked here.
2026-02-17