Google Lens in YouTube Shorts: Visual search enhances short video experience

Google is expanding the functionality of YouTube Shorts by integrating Google Lens, enabling direct visual search within short videos.This new feature allows users to identify objects, places or text in Shorts and access further information without having to leave the app.

Visual search directly in the video

The new feature is available in the YouTube mobile app for iOS and Android. When watching a Short, you can pause the video and select the Lens icon from the top menu. You can then select or tap a specific section of the image, and Google Lens will display relevant search results and visual matches directly above the video. Lens also offers the option to translate text that appears on the screen.

How to use Google Lens in YouTube Shorts

• Open the YouTube app on your smartphone and launch the Shorts player by either tapping the ‘Shorts’ tab or selecting a short video from the home screen.
• Pause the short by tapping the video once.
• Select Lens from the top menu. You can then draw, highlight or tap something in the video to search for it using Google Lens.
• Visual matches and search results will be displayed directly above the short. From there, you can seamlessly jump back to the original video.

Click here for the official announcement from Google.

AI-powered results without advertising

The search results provided by Google Lens within YouTube Shorts include so-called ‘AI Overviews’. These are short summaries generated by artificial intelligence that provide contextual information about the recognised image content. This feature is currently in a test phase, during which no ads will be displayed within the Lens results. In addition, the feature is disabled in Shorts with affiliate products or sponsored content to avoid advertising conflicts.

Potential for users and brands

The integration of Google Lens into YouTube Shorts represents a significant step forward in the platform’s development. Users are given an interactive way to learn more about the content they see. For brands and content creators, this opens up the opportunity to make their content even more appealing through visual elements and increase interaction with their audience.

This innovation sets YouTube apart from other platforms such as TikTok and Instagram Reels, which do not currently offer comparable visual search capabilities.

The integration of Google Lens into Shorts could permanently change the way users interact with short videos and pave the way for new forms of content creation and monetisation.