Google’s Gemini Now Supports Video and Screen-Based Queries for Real-Time Assistance

Google unveiled new features for its AI assistant, Gemini, at the Mobile World Congress (MWC) 2025 in Barcelona, aimed at enhancing user interaction with real-time video and screen sharing capabilities.

The company introduced the ‘Screenshare’ feature, which allows users to share what’s on their phone’s screen with Gemini. This enables real-time, context-aware assistance, as users can ask Gemini questions about their immediate surroundings or activities. For example, in a demo, a user shopping for a pair of baggy jeans asked Gemini for recommendations on clothing that would pair well with them. Gemini, utilizing the shared video, suggested matching outfits, including fits and jackets.

Google’s video search feature enables users to interact with Gemini by asking direct queries while they are recording their videos. This feature was initially introduced by Google at Google I/O 2024 and is currently being implemented. The system enables users to receive instantaneous feedback from Gemini during video recording by displaying recommendations in real-time.

The professional implementations of the feature were demonstrated during the demonstration. A ceramicist sought guidance from Gemini regarding glazes that would be appropriate for recently fired vessels during the demonstration. Gemini was directed to recommend glazes that would achieve the intended mid-century modern aesthetic by the camera movements.

These new features provide substantial benefits, particularly for users who may find it difficult to organise prompts or elucidate intricate issues. The real-time video and screen sharing capabilities enhance the efficiency of communication, enabling Gemini to more quickly diagnose and resolve issues on an accurate basis. Furthermore, the features offer a more interactive and personalised educational experience, as users can visually illustrate issues and receive customised guidance.

Google plans to roll out these features to Gemini Advanced users on the Google One AI Premium plan for Android devices later this month.