At Envision, we have always been at the cutting edge of technology and innovation, with which we disrupt the old-fashioned norms of assistive technology for the better. Our latest game-changer is Ask Envision, a powerful new feature on the Envision App that leverages GPT-4 by OpenAI to provide simple yet powerful virtual assistance to better access information and understand the world around us.

Ask Envision can be used in Scan Text, Batch Scan, Describe Scene and when importing images or files into the Envision App.

This feature represents a generational leap in document interaction, allowing users to inquire about summaries, translations, and specific details of their scanned documents or images. Whether you use voice or text input, Ask Envision, is designed to provide insightful, accurate responses to your queries, transforming the way you interact with text.

This article contains the following: 

1. How to use Ask Envision with documents and imported images and files?
2. How to use Ask Envision when describing scenes?

How to use Ask Envision with documents and imported images and files?

In order to activate Ask Envision in the Envision App, the Reader must be open. To open the Reader, simply scan a single document with Scan Text, multiple documents with Batch Scan or import any desired images or files into the Envision App to activate Ask Envision.

Either type your question or use voice commands to ask about the content. Envision App will process your request and provide you with a detailed response. In addition, we have introduced a processing sound for Ask Envision requests, which makes the experience more interactive and user-friendly.

Follow the steps below to use Ask Envision:

Step 1: To open the Reader, simply scan a single document with Scan Text, multiple documents with Batch Scan or import any desired images or files into the Envision App to activate Ask Envision.

Step 2: You will hear a processing sound and the captured document or imported image or file will open the Reader. 

Step 3: At the bottom of the Reader, the first option will be the Ask Envision button. This will open the Ask Envision chat and, by default, the Keyboard Mode will be selected within Ask Envision Preferences.

Step 4: To Ask Envision a question with the Keyboard Mode type it in the text field and press Enter.

Step 5: If you want to switch to a voice conversation, you will find the Voice button to the left of the text field. Once selected, allow access to the microphone and tap on Start Recording to ask your question.

Step 6: Once you have formulated your question with voice input, to formulate more questions tap the Ask A New Question button.

Step 7: If you have already asked all your questions, you can tap on the Close button, and the chat will open again where you will be able to consult all your history of questions asked in both Keyword Mode and Voice Mode.

For detailed information on how to use the features that allow you to open the Reader and use Ask Envision, see Reader, Scan Text, Batch Scan and Library

How to use Ask Envision when describing scenes?

Describe Scene allows you to understand the scene in front of you. By using artificial intelligence we are able to provide you with a detailed description of your environment. This feature offers the following:

• Revamped Describe Scene: Now, not only can you select between a short or long description after capturing an image in Describe Scene, but you can also opt to directly engage with our new, exciting feature—‘Ask Envision about Images’. This allows you to ask questions about the image immediately, enhancing your interaction.
• Adjustable Timer in Describe Scene: Set a 3-second timer to suit your pace of capturing. scene: take it slow or skip the wait.
• Upgraded Envision It: Access the familiar ‘Envision It’ feature through the share sheet, and now with ‘Ask Envision’, start inquiring about images from your gallery right away.
• Envision in Apple Shortcuts: On iOS and iPadOS seamlessly integrate Envision with Apple’s Shortcuts app to create customized shortcuts that fit your needs.

To have the scene in front of you described, please follow these steps:

Step 1: Select the App tab and navigate to Describe Scene.

Step 2: The following three options will appear, which can be selected by double tapping with one finger if your screen reader is on: 

1. Get a short description
2. Get a detailed description
3. Ask a Question

Once you select any of the above options, Envision App will take an immediate picture of what is in front of you. Be sure to keep your hands steady when tapping on the desired option. Keep in mind that you can activate a 3-second timer to adapt it to your capture rate. This option can be enabled or disabled at the top left of this screen.

Step 3: Once the desired option is selected, the Ask Envision chat will open and provide you with the type of description selected, either short or detailed. By default, the Keyboard Mode will be selected within Ask Envision Preferences.

Step 4: To Ask Envision a question with the Keyboard Mode type it in the text field and press Enter.

Step 5: If you want to switch to a voice conversation, you will find the Voice button to the left of the text field. Once selected, allow access to the microphone and tap on Start Recording to ask your question.

Step 6: Once you have formulated your question with voice input, to formulate more questions tap the Ask A New Question button.

Step 7: If you have already asked all your questions, you can tap on the Close button, and the chat will open again where you will be able to consult all your history of questions asked in both Keyword Mode and Voice Mode.

Note: For iOS users you will be able to save the image with the description in your Photos album, this option is located on the top left, next to the Ask Envision Preferences option.

For more information, see our blogpost Discover What’s New in Envision App Version 3.4: A Leap Forward in Interactive Scene Descriptions Powered By Ask Envision