Quote:Microsoft is adding a new AI feature in Click To Do, that will describe the content in photos. More AI in Windows 11, here we go again.

You may have heard of Click To Do before, it was introduced in April this year for Copilot+ PCs. Initially, the AI powered features were limited to reading options. But the tool has evolved over time, and can help you extract text from images to the clipboard, search the web, send email, etc. You can read more about it on Microsoft's support article.

Let's look at the newest feature, Describe Image. Microsoft says that users can select the "Describe Image" action from the right-click menu in the Photos app. The AI will describe the image's contents in a couple of sentences. Microsoft points out that this can be useful for getting an overview of visual content such as charts, graphs. Here's a screenshot of the Describe Image feature in action.



When you use the option for the first time, the app will download the required models and set it up for use. So, it is an optional feature. According to the announcement, the descriptions that the app provides are generated locally on your PC, to ensure your privacy. This suggests that it should work offline.

Continue Reading...