Microsoft Is Testing Semantic Search for Copilot App on Windows 11

Don't miss out on our latest stories.Add The Shiro Copras a preferred source on Google.

Microsoft is bringing semantic search to the Copilot app on Windows 11.

With this update, Insiders will be able to search for files and images using natural language. In other words, you can just describe what you're looking for instead of remembering the exact file name or words mentioned in the file. Sharing examples, Microsoft says you can use queries like "find images of bridges at sunset on my PC," "find my CV," or "find the file with the chicken tostada recipe" to get to your desired items.

To test the feature, Insiders need to have aCopilot+ PCand download the latest version of the Copilot app (version 1.25082.132.0 and higher) from the Microsoft Store. It currently works in English, Chinese (Simplified), French, German, Japanese, and Spanish.

Semantic searchwas first added to Windows Search, File Explorer, and the Settings app on Copilot+ PCs earlier this year. At the time, Microsoft said it didn't require an internet connection and relied on a small language AI model that runs locally on your device's Neural Processing Unit (NPU). It alsosaidthat none of the data collected would be "sent to any other computer or to Microsoft." It is unclear if all of these conditions apply as the feature comes to the Copilot app. We have contacted Microsoft for clarification.

However, to confirm what theCopilot appYou can go to Copilot Settings under Permission settings to access, retrieve, or read.

The Copilot app update also adds two other features. A redesigned homepage now displays your recent apps, files, and conversations. For now, it fetches PNG, JPEG, SVG, PDF, DOCX, XLSX, CSS, JSON, and TXT files from your standard Windows "Recent" folder.

It's also getting aVisionupdate.AccordingTo The Verge, if you pick an app from the "Get guided help" section of the homepage, a Vision session will scan everything on your screen and guide you through the basics of the app.

All of these features are packed into the latest version of the Copilot app for Copilot+ PCs, but they are "gradually rolling out, so not all Insiders will get the update right away," Microsoft adds.