With Describe Scene you can get an AI-generated description of the scene in front of you just by taking a photo. This feature supports you in understanding how new places and environments look like.

This article contains the following:

• Describe Scene Beta Version for Read and Home Edition Users
• New Describe Scene for 2024 Software Updates Pass, Professional Edition Users
  • Key Enhancements
  • How to Use the New Describe Scene?
  • Interactive Follow-Up Questions
  • Limitless Possibilities with Describe Scene
• The Remarkable Evolution of the Describe Scene Feature on The Envision Glasses

Describe Scene Beta Version for Read and Home Edition Users

Our ChatGPT-like virtual assistant Ask Envision is now present in this feature in beta version. To have a scene described, follow these steps: 

Step 1: Navigate to the main menu and do a one-finger double tap in Describe Scene.

Step 2: Before doing a one-finger double tap to activate the feature, point your head in the direction that you want it to describe to you. Usually it’s better to look a little more down.

Step 3: Now do a one-finger double tap on the Describe Scene feature.

Step 4: A countdown sound will be played followed up by a camera shutter. This means a snapshot has been taken and the picture is processed. Upon completion, the scene will be spoken out. A very detailed description will be given to you.

Step 5: To use our virtual assistance Ask Envision and query about this specific scene you can press for 2 to 3 seconds and release the Hinge Button, until you hear a chime, then ask your question and wait for the virtual assistant to answer you. The Hinge Button is located where the titanium frame meets the plastic body of your Envision Glasses. Found on the top of the body of the glasses. If you have trouble locating it, please tap here to access a video tutorial, which you can show to a sighted friend for assistance.

Step 6: To continue asking more questions the Hinge Button as many times as you wish. Keep in mind that each question needs to be asked separately and voice prompts can be in any of the Supported Device Languages by Envision Glasses. Simply select it as the Device Language under Settings and that's it, as long as you are connected to the Internet. For detailed information on how to change your preferred language, please see Change Device Language

Step 7: If you want to save the shared description, you can do a two-finger single tap to open the Export option, do a one-finger double tap and the description will be saved in your Envision Library in Envision App.

New Describe Scene for 2024 Software Updates Pass, Professional Edition Users

This version marks a significant leap forward from the beta version, delivering unparalleled accuracy and richness in image description and is for everyone who has the 2024 Software Updates Pass or unlimited software updates such as Professional Edition holders. For more information, please see Software Updates Pass For Read & Home Edition Users

Key Enhancements

• Improved Accuracy: Drastic reduction in hallucinations, ensuring highly accurate descriptions.
• Richer Descriptions: The level of detail in the descriptions now closely matches, and sometimes surpasses, human-generated descriptions.
• Lightning-Fast Scene Descriptions: Quickly and accurately understand your surroundings with near-instantaneous feedback.
• Faster AI Assistance: Get faster replies with Ask Envision inside the Reader and when asking follow-up questions.

How to Use the New Describe Scene?

Step 1: Ensure your Envision Glasses are updated to 2.5.1 software version. For more information on how to update the software, see Update Software
Step 2: Navigate to Describe Scene in the Main Menu. The Beta tag is now removed, indicating its full-fledged functionality.
Step 3: Do a one-finger double tap to activate. The glasses will take a picture after 3 beeps and then process the image to provide a concise, Alt-text sized description of the captured scene. 
Step 4: You can then press and hold the Hinge Button for 2 seconds and Ask Envision interactive follow-up questions. Here are a few examples of what you can do.

Interactive Follow-Up Questions

• Richer Descriptions: Request a more detailed description by saying, 'Describe this image in as much detail as possible.'
• Specific Elements: Ask for detailed descriptions of particular aspects, like 'Describe the clothing of the man in more detail?' or 'What items are on the table?'
• Detail Inquiries: Get specific details about objects by asking, 'What kind of a plant is that?' or 'What does the label on the can say?'

Limitless Possibilities with Describe Scene

The new Describe Scene feature is designed to understand the world around you with incredible depth and precision. We encourage you to explore its capabilities, test its limits, and share your feedback with us. Your experiences are invaluable in our continuous effort to improve and innovate.

‍Enjoy the new level of visual interpretation with Envision Glasses, where Technology Meets Perception. For more information, see our blogposts Envision Glasses Introduces A Generational Leap in Describe Scene Feature and Envision Glasses Unveil Instant Results: Lightning Speed AI Assistance with Ask Envision & Scene Descriptions.

The Remarkable Evolution of the Describe Scene Feature on The Envision Glasses

Interactive elements such as Ask Envision marks a significant leap towards our goal of a more conversational and intuitive future in assistive technology. As we celebrate these incremental innovations, we invite you to join us in looking forward to what 2024 will bring.

Watch the video to witness Karthik demonstrate the upgrades of the Describe Scene feature across the years.

This feature only works in online mode, therefore it is necessary to be connected to a stable network to get the most out of it. That does not mean when you are not connected to the internet you can not use the device. To find out which features do not require an internet connection, see Which features work without an Internet connection?