Google DeepMind’s AI is generating descriptions for YouTube Shorts

Google recently combined DeepMind and Brain teams into one big AI team called Google DeepMind. The new team has now shared details on its purported first work together. The group details how one of its visual language models (VLM) is being used to generate descriptions for YouTube Shorts.

“Shorts are created in just a few minutes and often don’t include descriptions and helpful titles, which makes them harder to find through search. So we introduced our visual language model Flamingo to help generate descriptions,” Google DeepMind wrote in the post.

The visual language model, called Flamingo, can make descriptions by analysing the initial frames of a video to explain what’s going on. Flamingo is generating descriptions for all new shorts