Open AI’s Spring Update Keynotes announced new and improved Voice Mode and also showcased Vision Mode, wherein you can have real-time conversation with ChatGPT using your camera. At the same time, ChatGPT-4omni was launched to free users with the capabilities of ChatGPT 4.
OpenAI also posted in their recent blogpost that GPT-4o, their new flagship model that can reason across audio, vision, and text in real time will be rolling out in the coming weeks.
Looks like the time is near, as the latest ChatGPT beta v1.2024.163 prompts for the New Voice Mode, which will let you chat with your camera ON!
The app says New Voice Mode coming soon. We plan to launch a new Voice Mode with new GPT-4o capabilities in an alpha within ChatGPT Plus in the coming weeks. It will latest come to free users once the alpha testing is done. Vision Mode may be released at the same time.
Here is the notice:
The watch demo leads to the OpenAI blogpost which has the following demo:
Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: https://t.co/MYHZB79UqN
Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks. pic.twitter.com/uuthKZyzYx
A new video has also been uploaded on OpenAI YouTube channel featuring the demo. The description says the following:
Voice mode is already available for all users in the ChatGPT app (tap the 🎧on the bottom right!) but our new voice and vision capabilities with GPT-4o (demonstrated here) will be rolling out in the coming weeks.
Custom GPTs Available for Free Users in the ChatGPT App
While Custom GPTs were already available since last month, it was restricted to the desktop or browsers app only. The ChatGPT app on Android and iOS did not open the GPTs to free users.
With today’s beta update, GPTs can be accessed on the Android app with free subscription as well! You can access the Custom GPTs by left hamburger menu. Simply tap the three horizontal like in the top left corner and select Explore GPTs.
Screenshot of ChatGPT Custom GPTs like DALL-E
ChatGPT Assistant
Under settings, ChatGPT now has a new option called Background Conversations. Toggling this option to ON will keep the conversation going even if you leave the app and move onto other apps. It will also work with screen off as well! The notification panel will have a notification to end the conversation.
ChatGPT Background ConversationsChatGPT in Notification Panel
This can be made even more useful by adding ChatGPT to your home screen and start using it as a personal Assistant with real-time conversations.
It is now possible to add an activity on your Android device’s home page, which will directly launch the Voice Mode and start a conversation. However, it can’t be activated with voice just yet, like Hey Google or Hey ChatGPT. We have seen similar feature implemented in Nothing Phone with ChatGPT widget.
The Juniper voice has also been tweaked a bit to sound more natural. The voice seems closer to Sky, which was removed soon after the launch.
Latest ChatGPT APK Download with GPTs
The latest beta version of ChatGPT with build 1.2024.163 will soon activate New Voice Mode. It already offers Custom GPTs for free! Download the ChatGPT app now!
The official account of the AndroidSage team writing news articles, how to guide, and reviews about Android, smartphones, Android Apps. Trending on news about the latest tech developments.