Up nextNext guide
Text Annotation for NER and Classification
Language AI
Language AI GUIDE
Text classification automatically sorts pieces of text into categories, like tagging an email as spam or a review as positive.
Listen to this guideAI-narrated · ~3 min
It is one of the most widely deployed NLP tasks because it turns messy free text into structured labels a system can act on.
Text classification assigns categories to documents, messages, or other text sequences. Binary classification selects between two labels, such as spam and not spam. Multi-class classification assigns exactly one category from a larger set, while multi-label classification permits several categories for the same example. An article can carry both politics and economy tags without requiring those topics to exclude each other. Sentiment and intent can also be classification targets when the task defines their labels. Representations differ across systems: sparse word-count features and dense learned embeddings are two possibilities. A classifier converts those features into scores associated with the defined labels. Evaluation should match the intended decisions. Accuracy is the fraction of correct predictions, but it can conceal failures on a rare category. If almost every message is ordinary, always predicting ordinary can score highly while missing every relevant spam case. Recall for a designated positive class is true positives divided by all actual positives. Precision instead divides true positives by all predicted positives. In an illustrative evaluation with six true positives and two false positives, precision is six divided by eight, or 75 percent. Those quantities answer different questions. A model can have a useful recall yet flag many irrelevant messages. A further distinction concerns output scores: single-label softmax scores sum to one across mutually exclusive alternatives, whereas a separate sigmoid score for each label permits several labels to score highly together. Neither transformation alone establishes that scores are calibrated estimates of real-world frequency.
Email providers filtering spam and phishing messages out of your inbox.
Brands running sentiment analysis on product reviews and social posts to gauge customer mood.
Support desks auto-routing incoming tickets to the right team based on the message content.
Social platforms flagging hate speech or toxic comments for moderation review.
Label descriptions and examples can make it easier to explore a new classification task, but they do not establish consistent performance across domains. Comparing sparse models, dense encoders, and prompted language models can reveal different accuracy, latency, and maintenance tradeoffs. For operational use, evaluation should include rare classes and the consequences of missed or incorrect labels. Changes in language and input sources can also change those results. Report per-class precision and recall where relevant, and assess output calibration separately from the act of assigning a category.
Free newsletter
One short email each weekday with the three AI stories that actually matter. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Text classification automatically sorts pieces of text into categories, like tagging an email as spam or a review as positive. It is one of the most widely deployed NLP tasks because it turns messy free text into structured labels a system can act on.
The output associates the text with the categories defined by the task.
Multi-label classification allows more than one category to apply to the same item simultaneously.
Predicting the majority class can yield high accuracy while missing all rare positives, so category-specific evaluation matters.
Recall is the fraction of true positive cases that the system correctly identified, capturing how much it missed.
A zero-shot model can be pretrained or trained on other tasks; the absence concerns task-specific labeled examples.
Keep learning
More guides picked for this topic
Up nextNext guide
Text Annotation for NER and Classification
Language AI