Get an AI-generated description of the scene in front of you just by taking a photo. This feature supports you in understanding how new places and environments look like. Our ChatGPT-like virtual assistant Ask Envision is now present in this feature in beta mode.
To have a scene described, follow these steps:
Step 1: Navigate to the main menu and do a one-finger double tap in Describe Scene.
Step 2: Before doing a one-finger double tap to activate the feature, point your head in the direction that you want it to describe to you. Usually it’s better to look a little more down.
Step 3: Now do a one-finger double tap on the Describe Scene feature.
Step 4: A countdown sound will be played followed up by a camera shutter. This means a snapshot has been taken and the picture is processed. Upon completion, the scene will be spoken out. A very detailed description will be given to you.
Step 5: To use our virtual assistance Ask Envision and query about this specific scene you can press for 2 to 3 seconds and release the Hinge Button, until you hear a chime, then ask your question and wait for the virtual assistant to answer you. The Hinge Button is located where the titanium frame meets the plastic body of your Envision Glasses. Found on the top of the body of the glasses. If you have trouble locating it, please tap here to access a video tutorial, which you can show to a sighted friend for assistance.
Step 6: To continue asking more questions the Hinge Button as many times as you wish. Keep in mind that each question needs to be asked separately and voice prompts can be in any of the Supported Device Languages by Envision Glasses. Simply select it as the Device Language under Settings and that's it, as long as you are connected to the Internet. For detailed information on how to change your preferred language, please see Change Device Language
Step 7: If you want to save the shared description, you can do a two-finger single tap to open the Export option, do a one-finger double tap and the description will be saved in your Envision Library in Envision App.
Note: As this is a beta feature, please allow some room for refinement. We look forward to you exploring its potential. Please feel free to share your feedback with us at email@example.com, as it is extremely valuable to hear your experience with this tool that we continue to enhance increasingly internally.
In the following video, you can see our supercharged Describe Scene in action:
To learn more about the benefits of this feature, see our blog post Envision Glasses Version 2.3.1 Reveals Supercharged Scene Descriptions And Multilingual Voice Input for Ask Envision
This feature only works in online mode, therefore it is necessary to be connected to a stable network to get the most out of it. That does not mean when you are not connected to the internet you can not use the device. To find out which features do not require an internet connection, see Which features work without an Internet connection?