Microsoft Edge Gets Accessibility Captions… for Images

Captions are an effective way to assist folks with accessibility points perceive the content material they’re consuming, and now Microsoft needs to make them even higher. The corporate has introduced that Microsoft Edge will now “caption” photographs in order that these which are exhausting of sight know what is going on on.

Microsoft Edge’s New Picture Descriptions

Microsoft made the announcement on the Microsoft Edge Blog. The captioning is supposed to reinforce narrators, which learn out the content material on a webpage.

Typically, web site homeowners will set textual content on photographs themselves (known as “alt textual content”) which a narrator will learn out. Which means these with diminished eyesight can “hear the picture” and perceive what is going on on on the web site.

Nonetheless, typically web site homeowners do not set textual content, which leaves a narrator at nighttime about what the picture is. If this occurs in Microsoft Edge, it may add the picture to the Pc Imaginative and prescient API for Azure Cognitive Providers.

Microsoft states that the API works with many of the extra well-used picture codecs, comparable to JPEG, PNG, and even GIFs. As soon as the API thinks it is aware of what is going on on, it’s going to create its personal caption for the consumer’s narrator to make use of. The API can establish each what is going on on in a picture, and any textual content printed on it.

There are a couple of limitations to the function, although. It will not course of the next:

  • Photographs which are marked as “ornamental” by the website writer. Ornamental photographs don’t contribute to the content material or which means of the website.
  • Photographs smaller than 50 x 50 pixels (icon dimension and smaller)
  • Excessively massive photographs
  • Photographs categorized by the Imaginative and prescient API as pornographic in nature, gory, or sexually suggestive.

It would additionally skip over any photographs that the web site proprietor has already set textual content for. Which means human-written alt textual content will all the time be prioritized over what the API thinks it ought to say.


If the API does generate its personal description, the narrator will state that the picture “seems to be…” earlier than describing it. Any textual content it detects can be launched with “seems to say…” in order that listeners perceive that the narrator is making a guess utilizing the API, as a substitute of utilizing the web site proprietor’s personal textual content.

An Accessibility Win for Edge

Browser builders are all the time making an attempt to one-up one another to change into the highest canine, however a race to change into probably the most accessible browser available on the market is a win for everybody. People who find themselves exhausting of listening to or sight can browse the web higher than ever as firms struggle to provide one of the best expertise.

Different firms outdoors of the net shopping market are providing their very own tackle this tech. As an illustration, in January 2021, Fb made enhancements to its AI picture description service to assist those that want support.

As such, those that need assistance browsing the web could discover solace in Microsoft Edge. And given the way it comes pre-installed with each copy of Home windows 10 and 11, it means there’s minimal setup to get this function working.

Making the Web Accessible, One Characteristic at a Time

Any information to assist those that need assistance is nice information, and Microsoft Edge’s picture description service appears to be a winner. We’ll must see if different browsers reply in variety to this growth.

metallic spotify logo

10 Causes Why You Should not Use Spotify

Learn Subsequent

About The Creator

Leave a Comment

Your email address will not be published. Required fields are marked *