Google’s Gemini Live Gets Project Astra Boost: Camera and Screen Sharing Rolling Out
Google is gradually releasing Project Astra-powered features to Gemini Live, fulfilling the promise made at Mobile World Congress (MWC) earlier this month. This upgrade introduces real-time camera interaction and screen sharing capabilities, significantly enhancing the conversational AI experience. While the rollout is still in its early stages, the first reports indicate that users are beginning to see the new functionalities appear on their Android devices.
One early adopter has reported the appearance of a "Share screen with Live" button within the Gemini overlay. This button sits above the existing "Ask about screen" suggestion chip and the main "Ask Gemini" input field, providing a clear indication of the new screen sharing functionality. Currently, screen sharing encompasses the entire display, with no option to restrict sharing to a single application. This means that everything visible on the user’s screen, including notifications and other sensitive information, will be shared during the Gemini Live session. Users should be mindful of this when initiating screen sharing and ensure they are not displaying any confidential data.
The same user has also gained access to real-time camera capabilities, allowing for interactive experiences with the world around them. This is enabled by opening the full Gemini Live interface and initiating a video stream. A button located in the bottom-right corner of the screen facilitates switching between the front and rear-facing cameras. This functionality could enable a wide range of use cases, such as getting assistance with troubleshooting a technical issue by showing the device’s components, receiving guidance on cooking a recipe by displaying the ingredients and cooking process, or simply sharing a live view of the user’s surroundings with Gemini.
Google is strategically implementing a slow and gradual rollout to ensure a stable and optimized user experience. This approach allows them to monitor performance, identify potential bugs, and gather user feedback to refine the feature before wider deployment. While the features are not yet live on all devices, the initial report provides a glimpse into the potential of Project Astra in enhancing Gemini Live.
Gemini Live itself has received a visual and functional overhaul to accommodate these new capabilities. It now utilizes a phone call-style notification system, providing a more intuitive way to manage active sessions. The interface has also been redesigned to be more compact and fullscreen, maximizing the available screen real estate for both the conversational AI interaction and the shared screen or camera view. However, this new interface is also part of the staggered rollout and may not be immediately available to all users.
The initial report of the feature’s activation originates from a user with a Xiaomi phone and a Google One subscription. This observation, coupled with Google’s previous statements, sheds some light on the potential prerequisites for accessing these new features. During the MWC demos, Google stated that Project Astra capabilities would be available to Gemini Advanced subscribers (those on the AI Premium plan, which starts at $19.99 per month) and Android devices in general, without specifying a particular Android version.
However, earlier in January, Google indicated that Pixel (and Galaxy S25 series) owners would be "among the first to get Project Astra capabilities like screen sharing and live video streaming." This statement suggests that while Gemini Advanced subscribers on Android devices are likely to have access, Pixel devices may receive priority in the rollout. It remains unclear if there are any technical limitations preventing the broader availability of Project Astra across all Android devices. There appears to be no inherent reason to restrict access based on device manufacturer or model.
While Android users are starting to see the benefits of Project Astra integration, the situation for iPhone users remains unclear. Google has yet to explicitly address expanded support for iOS devices. While the "Talk Live" feature for photos, files, and YouTube videos is currently unavailable on iOS, it remains to be seen if Google will eventually bring the full Project Astra experience to Apple’s mobile platform. The competitive landscape in the AI assistant space may influence Google’s decision on prioritizing iOS support.
The introduction of screen sharing and real-time camera interaction to Gemini Live represents a significant step forward in the evolution of conversational AI. These capabilities transform Gemini from a purely text-based assistant to a more versatile and visually aware tool. The potential applications are vast, ranging from remote technical support and educational assistance to collaborative problem-solving and interactive experiences.
As the rollout progresses and more users gain access to these features, it will be crucial to monitor user feedback and identify best practices for utilizing these new capabilities. Google will likely continue to refine the user interface, optimize performance, and address any potential security or privacy concerns. The integration of Project Astra into Gemini Live is poised to redefine the way users interact with AI assistants, blurring the lines between the digital and physical worlds. The coming months will be pivotal in shaping the future of conversational AI and determining the ultimate impact of Project Astra on the broader technological landscape.
