I-Computer Vision
Computer vision builds systems that extract information from images or video.
Uhlolojikelele
Tasks include classification, object detection, segmentation, tracking, and visual question answering. Each task asks for a different output, and none automatically provides a complete understanding of a scene.
Okuthathwayo okubalulekile
- Define the visual task and output.
- Test realistic capture conditions.
- Evaluate preprocessing and shortcuts.
I-Deep Dive
Images become numerical arrays that encode pixels or other representations. A model learns patterns useful for its objective, but those patterns can include accidental correlations. A classifier may rely on a background rather than the object a developer intended it to recognize. Define the output precisely. Classification assigns labels to an image; detection locates object instances; segmentation labels pixels or regions. A model that identifies an object category may still fail to locate its boundary or distinguish several overlapping instances. Evaluate on realistic cameras, lighting, resolutions, viewpoints, and environments. Keep related images from the same scene or recording together when splitting data to avoid overly optimistic results. Inspect uncommon conditions and the cost of different mistakes. The application must also handle image quality, permissions, uncertainty, and downstream actions. A confident label is not proof that a scene is safe or that an inferred attribute is appropriate to use. Preserve the source image and meaningful review information when people need to check a result.
I-Technical Insight
Image resizing and cropping can remove small objects or context before the model runs. Input preprocessing is part of the system being evaluated.
Test for a background shortcut
- Construct a toy dataset where every training image of a red toy is on a white table and every blue toy is on a dark table.
- Test the toys on swapped backgrounds and on an unseen surface.
- If predictions follow the table rather than the toy, revise the data and evaluation rather than assuming the original accuracy measured the intended concept.
The invented setup illustrates a shortcut that a visually plausible demonstration can hide.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ukuqaliswa Komhlaba Wangempela
Detect manufacturing defects under the actual camera and lighting setup.
Classify authorized document images before routing them to a suitable extraction process.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Imithombo nokufunda okuqhubekayo
- Radford and colleaguesVision-language representation learning
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Computer Vision quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Umbono-Ulimi-Action Models for Robotics
Imibuzo evame ukubuzwa
Does identifying an object mean the system understands the whole image?
No. Object recognition is one task. Relationships, context, uncertainty, and safe use require separate evaluation.