Free AI library

Language AI guidesFree forever.

155 plain-English guides, structured learning paths, and an open library — built by an independent 501(c)(3) nonprofit so anyone can understand modern AI.

155Free guides
1Topic tracks
~2 minPer guide
~5hReading time

Start here

Five outcome-based courses

Each course includes explicit outcomes, mapped competencies, practice activities, and an applied capstone.

Topic tracks

Browse by track

Jump into the area you care about. Every track has multiple plain-English guides.

Full library

All guides

155 of 1019 guides shown. Filter by track or search above.

Language AI

Repetition Penalty and Decoding Controls

Decoding controls are the knobs that decide how a language model picks each next word from its probability distribution.

2 min readRead
Language AI

ALiBi Position Bias

ALiBi (Attention with Linear Biases) is a clever way to give transformers a sense of word order without traditional position embeddings.

2 min readRead
Language AI

Multi-Query Attention

Multi-Query Attention (MQA) is a memory-saving twist on transformer attention that shares one set of keys and values across all attention heads.

2 min readRead
Language AI

SentencePiece Tokenization

SentencePiece is a language-agnostic tokenizer that learns how to split raw text into subword pieces directly from data, without relying on spaces.

2 min readRead
Language AI

WordPiece Tokenization

WordPiece is the subword tokenization algorithm that powers BERT and many Google models, splitting words into reusable fragments so a model can handle any…

2 min readRead
Language AI

Sentence-BERT Embeddings

Sentence-BERT (SBERT) adapts BERT to produce a single fixed-length vector for an entire sentence, so meaning can be compared with fast cosine similarity.

2 min readRead
Language AI

T5 and Text-to-Text Transfer

T5 (Text-to-Text Transfer Transformer), from Google in 2019, reframes every NLP task, translation, summarization, classification, even regression, as feeding…

2 min readRead
Language AI

Dense Passage Retrieval

Dense Passage Retrieval (DPR) finds relevant text by comparing the meaning of a question and passages as numeric vectors, not matching words.

2 min readRead
Language AI

BM25 and Lexical Retrieval

BM25 is the classic keyword-based ranking function that scores documents by how often query terms appear, adjusted for term rarity and document length.

2 min readRead
Language AI

HyDE Hypothetical Document Embeddings

HyDE improves retrieval by first asking a language model to imagine a fake answer document, then searching with that document's embedding instead of the raw…

2 min readRead
Language AI

Speculative Decoding Draft Models

Speculative decoding uses a small, fast 'draft' model to guess several upcoming tokens that a large model then verifies in one pass.

2 min readRead
Language AI

Lookahead Decoding

Lookahead decoding speeds up LLM generation without any extra draft model by guessing and verifying multiple future tokens in parallel using n-grams…

2 min readRead

Finished reading? Prove it.

Check what you learned with topic quizzes, then explore our structured courses and current certification requirements. Core guides remain free to read.