Google has begun adding new features to Gemini Live, its artificial intelligence (AI) assistant, giving it the ability to view a phone screen or camera feed and answer questions in real time.
These updates are based on the technology behind Project Astra, which the company first showed off in May 2024.
Currently, they appear limited to select Android phones, with one early case reported on a Xiaomi device using the $19.99/month Gemini Advanced plan. Google has said that Pixel and Galaxy S25 users will likely be among the first to receive full access to these tools.
Did you know?
Subscribe – We publish new crypto explainer videos every week!
What Are Crypto Rollups? ZKSnarks vs Optimistic Rollups (ANIMATED)
Some Android users, including one with a Xiaomi device, have already noticed the changes. That user shared a video showing Gemini reacting to on-screen content as it was happening.
Another feature lets Gemini view a live video from the phone’s camera and respond to what it sees. In a demonstration by Google, a user asked the assistant to suggest a paint color for pottery they had just finished glazing. The assistant gave advice based on what it saw through the camera feed.
To use the screen-sharing function, users must open Gemini Live and tap a new button labeled “Share screen with Live”. This feature currently only supports sharing the whole screen—not individual apps.
Meanwhile, users need to start a video session within Gemini Live to start the cameral tool. A small icon in the corner of the screen allows them to switch to the front-facing camera and begin using the assistant that way.
On March 12, Google introduced Gemma 3, the latest version of its lightweight AI models. How does it compare to earlier versions? Read the full story.
Having completed a Master’s degree in Economics, Politics, and Cultures of the East Asia region, Aaron has written scientific papers analyzing the differences between Western and Collective forms of capitalism in the post-World War II era.
With close to a decade of experience in the FinTech industry, Aaron understands all of the biggest issues and struggles that crypto enthusiasts face. He’s a passionate analyst who is concerned with data-driven and fact-based content, as well as that which speaks to both Web3 natives and industry newcomers.
Aaron is the go-to person for everything and anything related to digital currencies. With a huge passion for blockchain & Web3 education, Aaron strives to transform the space as we know it, and make it more approachable to complete beginners.
Aaron has been quoted by multiple established outlets, and is a published author himself. Even during his free time, he enjoys researching the market trends, and looking for the next supernova.
