Up nextNext guide
Data Flywheels: Turning Production Data into Training Data
Technical
Technical GUIDE
Influence Functions for Training Data Attribution
Influence functions estimate how much each training example shaped a model's prediction, letting you trace an output back to the data that caused it.
Listen to this guideAI-narrated · ~2 min
On this page2 min read
Overview
They matter because they turn an opaque model into something auditable for copyright, debugging, and trust.
Deep Dive
Influence functions come from robust statistics and were adapted to deep learning by Koh and Liang in 2017. The core question is counterfactual: how would the model's loss on a test point change if a particular training example were removed or up-weighted? Rather than actually retraining (which is hopelessly expensive), influence functions approximate that change using calculus. They compute the gradient of the loss for the training point and the test point, then connect them through the inverse Hessian of the loss, which captures the curvature of the model's parameter space. Under Koh and Liang’s standard upweighting-on-test-loss convention, I_up,loss measures how infinitesimally increasing a training point’s weight changes the loss on a chosen test point. A positive value means upweighting raises test loss (a harmful influence); a negative value means it lowers test loss (a helpful influence). Removing a point reverses the sign of the first-order estimated change. Other influence scores may target predictions or use a different sign convention, so define the quantity before interpreting its sign. The result is a ranked list of the most responsible training examples.
Real-World Implementation
Tracing which copyrighted books most influenced a passage a language model generated, for legal and licensing analysis
Debugging a misclassification by surfacing the mislabeled training images that pushed the model toward the wrong answer
Detecting poisoned or anomalous training examples that exert outsized influence on specific predictions
Auditing a credit or hiring model to show which historical records drove a contested decision
The Future of Influence Functions for Training Data Attribution
Expect influence-based attribution to become infrastructure for AI accountability. Regulators and courts probing whether copyrighted text shaped an output will want example-level provenance, and developers will use it to surface mislabeled or poisoned data. Cheaper approximations like TRAK and gradient-sketching are pushing attribution toward real time, and combining it with unlearning could let teams remove a document's influence without full retraining.
Putting it into practice
Why it matters
- Cost and budget. Architecture decisions drive performance and operating cost for years.
- Clearer decisions. Technical education helps teams choose the right stack, not just the newest one.
- Quality control. Better engineering choices reduce reliability incidents in production.
Watch out for
- Optimizing one benchmark can hide broader system weaknesses.
- Infrastructure and maintenance costs are often underestimated.
- Security and observability gaps can grow as systems become more complex.
Next steps
- Define latency, quality, and cost targets before implementation.
- Benchmark under realistic load and data conditions.
- Instrument monitoring for errors, drift, and user impact.
- Prepare rollback and incident response paths before scaling.
Keep Exploring
Free newsletter
Keep up with AI in 3 minutes a day
One short email each weekday with the three AI stories that actually matter. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Influence Functions for Training Data Attribution quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Frequently asked questions
What is Influence Functions for Training Data Attribution?
Influence functions estimate how much each training example shaped a model's prediction, letting you trace an output back to the data that caused it. They matter because they turn an opaque model into something auditable for copyright, debugging, and trust.
What counterfactual question do influence functions approximate?
Influence functions estimate the effect of perturbing a training example's weight on the loss at a test point, approximating leave-one-out retraining without doing it.
Which mathematical object makes exact influence computation intractable for large models?
The classic influence formula requires inverting the Hessian over all parameters, which is infeasible for models with billions of parameters.
Who adapted influence functions to modern deep learning in a well-known 2017 paper?
Pang Wei Koh and Percy Liang's 2017 paper 'Understanding Black-box Predictions via Influence Functions' brought the technique into deep learning.
Under Koh and Liang’s standard I_up,loss convention, what does a negative value indicate?
For I_up,loss, a negative derivative means increasing the training point’s weight decreases the selected test loss; removing it has the opposite first-order effect.
Which approximation did Anthropic use to scale influence functions to large language models?
Anthropic's 2023 study used EK-FAC to approximate the inverse Hessian, enabling influence analysis on large language models.
Keep learning
Related guides
More guides picked for this topic