How to Prompt with Images

A useful image prompt pairs the visual input with a concrete task: describe a feature, read a region of text, compare two objects, or explain a chart element. Add context that changes the interpretation, such as what labels mean or which area matters, and separate observations from conclusions. “Read the date printed in the upper-right corner” is easier to verify than “tell me everything about this document.” If an answer matters, ask for the exact visible text or the specific evidence the model used, then inspect that portion yourself. Capabilities and limits depend on the model and product. OpenAI’s current API vision guide says vision-capable models can describe images, read visible text, and answer questions about objects and visual properties. It also warns that models can misread small text, rotated content, graph styles, spatial locations, and approximate counts; some image resizing occurs even at original detail. Its detail settings differ by model, and the documentation recommends original detail for supported models when fine visual detail or OCR is needed. These are OpenAI-specific API details, not universal settings for all vision systems. Use the tool as an aid for inspection, not a substitute for measurement or expert judgment. Provide a clear, sufficiently detailed image, crop to a relevant region if the interface supports it, and ask one question at a time when the visual task is complex. For medical or other high-stakes images, do not treat a model’s description as diagnosis or a final decision. Verify text, counts, coordinates, and chart values with a reliable method when precision matters. Mention uncertainty instead of forcing the model to invent a definite reading from an unclear image.