All products

Read screenshot text on a Mac with AI

Copy a message out of a screenshot, locate a label in a busy window or see which parts of a photo draw attention.

Read screenshot text on a Mac with AI when a colleague sends a picture of a dialog and you need the exact wording. With macvision, a compatible agent can use Apple Vision on your Mac to transcribe the image. Ask for plain text to paste into a search box, or request positions and confidence scores when the layout matters.

Pictures without lettering have two other routes. Classification returns possible scene or object labels. A saliency map shows areas of visual interest, which can help you decide where to crop a photograph.

What it does

  • Copy an error message from a screen capture without retyping it.
  • Read a picture you have already copied to the clipboard.
  • Match a label to its position in an interface with several similar controls.
  • Look at the strongest classification suggestions before choosing a caption.
  • Inspect a local heatmap to see which areas compete for attention.

Install and use

  1. Install the official macvision command-line tool on macOS 13 or later and have the agent check that it is ready.
  2. Choose your image, then ask, “Extract the wording in the warning box and flag any uncertain characters.”
  3. Request a closer crop or a different recognition language if the lettering is small. Compare important numbers with the source.

FAQ

Source

Made by o98k-ok. Original skill: macvision, published on GitHub under the MIT licence.

View on GitHub