Glossary
Every term, in plain English
A living glossary - each term links to the lesson that introduces it. The same definitions pop up on hover throughout the lessons.
27 terms
Agent
Coming upAn LLM that can plan, use tools, and take multi-step actions toward a goal.
Lesson 10.1Artificial Intelligence (AI)
Software that performs tasks we'd normally call intelligent - the broad umbrella over ML, deep learning, and GenAI.
Lesson 1.1Chain of Thought (CoT)
Coming upPrompting a model to reason step by step, improving logic and math.
Lesson 2.3Context window
How much text a model can consider at once; long inputs can get truncated or lost.
Lesson 1.3Deep Learning
ML using many-layered neural networks that learn features directly from raw data (images, audio, text).
Lesson 1.1Embedding
Coming upA numeric vector capturing the meaning of text, so machines can compare similarity.
Lesson 8.1Feature engineering
Humans hand-picking the useful columns/inputs a traditional ML model learns from.
Lesson 1.1Generative AI
Deep learning trained to create new content (text, images, audio, code), not just classify or predict.
Lesson 1.1Hallucination
When a model states something false as if true, because it generates plausible text without a fact-check.
Lesson 1.3Knowledge cutoff
The date a model's training data ends; it can't know newer events without tools/search.
Lesson 1.3Large Language Model (LLM)
A large neural network that generates text by predicting the next token, trained on huge amounts of text.
Lesson 1.2Machine Learning (ML)
Algorithms that learn patterns from data instead of following hand-written rules.
Lesson 1.1MCP
Coming upModel Context Protocol - a standard way to connect models to tools and data sources.
Lesson 7.3Next-token prediction
How an LLM generates: it assigns probabilities to possible next tokens and samples one, repeatedly.
Lesson 1.2Post-training
Later training (fine-tuning + RLHF) that makes a base model helpful, honest, and safe.
Lesson 1.2Pre-training
The first training phase: predict the next token across internet-scale text (self-supervised) to learn language and knowledge.
Lesson 1.2RAG
Coming upRetrieval-Augmented Generation - fetch relevant documents and feed them to the model so it answers from real sources.
Lesson 8.2RLHF
Reinforcement Learning from Human Feedback - humans rank answers and the model learns what people prefer.
Lesson 1.2