Free AI library

Technical guidesFree forever.

177 plain-English guides, structured learning paths, and an open library — built by an independent 501(c)(3) nonprofit so anyone can understand modern AI.

177Free guides
1Topic tracks
~2 minPer guide
~6hReading time

Start here

Five outcome-based courses

Each course includes explicit outcomes, mapped competencies, practice activities, and an applied capstone.

Topic tracks

Browse by track

Jump into the area you care about. Every track has multiple plain-English guides.

Full library

All guides

177 of 1019 guides shown. Filter by track or search above.

Technical

Sequence Parallelism and Ring Attention

Sequence parallelism splits a single long input sequence across multiple GPUs along the token (time) dimension, and Ring Attention lets those GPUs compute…

2 min readRead
Technical

Activation Recomputation Tradeoffs

Activation recomputation (gradient or activation checkpointing) saves GPU memory during training by discarding intermediate activations in the forward pass…

2 min readRead
Technical

Group Relative Policy Optimization

Group Relative Policy Optimization (GRPO) is a reinforcement-learning method for fine-tuning language models that judges each answer against a group…

2 min readRead
Technical

Normalizing Flows

Normalizing flows are generative models that turn simple noise (like a Gaussian) into complex data through a chain of invertible, differentiable…

2 min readRead
Technical

Energy-Based Models

Energy-based models (EBMs) learn a scalar 'energy' function that assigns low values to plausible data and high values to implausible data, defining…

2 min readRead
Technical

Optimizer State Offloading to CPU and NVMe

A memory-saving trick that parks the heavy bookkeeping of training (optimizer states, gradients, sometimes weights) in CPU RAM or on NVMe SSDs instead…

2 min readRead
Technical

Checkpoint Sharding and Resumable Training

Techniques for saving a model's training state in pieces (shards) so giant models can be saved and reloaded without choking on memory or disk limits, and so…

2 min readRead
Technical

GPU Memory Management and Fragmentation

How AI frameworks allocate, reuse, and reclaim the limited memory on a GPU, and why leftover gaps (fragmentation) can cause out-of-memory errors even…

2 min readRead
Technical

Multi-Instance GPU Partitioning

Multi-Instance GPU (MIG) is an NVIDIA technology that slices a single physical GPU into multiple isolated hardware partitions.

2 min readRead
Technical

GPU Scheduling and Cluster Orchestration

GPU scheduling decides which jobs run on which accelerators and when, while orchestration coordinates these jobs across an entire cluster of machines.

2 min readRead
Technical

Slurm for AI Training Clusters

Slurm is an open-source workload manager that schedules and runs jobs on high-performance computing clusters, and it has become a default choice for large AI…

2 min readRead
Technical

Plan-and-Solve Prompting

Plan-and-Solve (PS) prompting tells a language model to first devise an explicit plan and then carry it out step by step, fixing the failures that plain…

2 min readRead

Finished reading? Prove it.

Check what you learned with topic quizzes, then explore our structured courses and current certification requirements. Core guides remain free to read.