Categories: News

Integrating Google’s AI into YouTube Shorts

The main attraction of YouTube’s Made On YouTube event on Wednesday morning was, you guessed it, artificial intelligence. The company announced that it is integrating Google DeepMind’s AI video generation model, Veo, into YouTube Shorts, letting creators generate high-quality backgrounds as well as six-second clips.

At Google’s I/O 2024 developer conference, Veo was unveiled as a cutting-edge video generation model. The technology directly competes with OpenAI’s Sora, as well as other rival video generation models, such as Pika, Runway, and Irreverent Labs. It can create 1080p video clips in various cinematic styles.

Veo in Shorts is meant to be a significant upgrade from YouTube’s AI-powered “Dream Screen” feature, which launched in 2023 to allow creators to generate backgrounds in Shorts using text prompts. YouTube believes the Veo model will enhance the video background generation process even further, enabling creators to produce more impressive clips. One of the key advantages of Veo is its capability to edit and remix previously generated footage. 

Additionally, this will be the first time creators can generate six-second-long standalone video clips for Shorts. When creators select “Create” and enter a prompt, Dream Screen will generate four images. They then select a photo to turn it into a video.

The new capability will help creators add filler scenes to their videos, allowing for smoother transitions and tying the overall story together. For example, creators can include scenes such as the New York City skyline at the beginning of a sightseeing video to add more context.

The company will integrate Veo into Dream Screen later this year. The creations on Shorts will be watermarked using DeepMind’s SynthID tech to mark them as AI-generated.

Image Credits:YouTube

In addition to the Veo integration, the company announced a slew of new features coming to YouTube, including “Jewels” and gifts, digital items that viewers can send during livestreams. This feature seems to be similar to TikTok’s “Gifts.” Jewels is aimed at providing new ways for viewers to interact with creators and actively participate in livestreams. The feature will start rolling out to vertical livestreams in the U.S.

YouTube also expanded its automatic dubbing tool to support more languages, including French, Italian, Portuguese, and Spanish. Notably, it’s testing “expressive speech,” or the ability to transfer a creator’s tone, intonation, and ambient sounds into dubbed audio, creating a more natural experience.

The company is expanding the availability of its Community hubs to more channels, giving creators and followers the ability to interact with each other, including being able to share posts and reply to each other.

It’s also introducing its “hyping” feature to additional markets. YouTube initially tested its Hype tool in Brazil, Turkey, and Taiwan, allowing users to express support for their favorite creators. Videos with the most hype points are showcased on a special leaderboard.

Additionally, the company revealed during today’s event that creators can now use AI to help brainstorm video ideas within YouTube Studio. They can also produce AI-generated thumbnails and respond to followers with new AI-assisted comments.

hbspt.forms.create({
region: “na1”,
portalId: “44101848”,
formId: “09f96578-8d24-4d8a-8e9f-7700cff83c29”
});

admage

Recent Posts

InstantIR: Restore Your Images

Figuring out the model that can fix your low quality pictures? Now, restoring your low…

4 days ago

Omnigen: Next-Gen Image Generation & Editing Tool

Traditional diffusion models uses various mechanisms for image modification like ControlNet, IP-Adapter, Inpainting, Face detection,…

1 week ago

Create Engaging Videos with Mochi1

Mochi 1, an open-source text-to-video diffusion model has been released by Genmo.  Trained with 10…

3 weeks ago

Local Installation of Stable Diffusion 3.5

So, it's finally here. Stable Diffusion 3.5 has been released by StabilityAI on October 22nd,…

4 weeks ago

Video Depth Mapper: Efficient 3D Depth Mapping Solution

Due to the extreme diversity of video content like motion, camera panning, and length, the…

1 month ago

Top 30 Negative Prompts for Reliable Diffusion Models

 You can use these negative prompts while generating images using Stable Diffusion models.1. Clear BrandingPrompt:text,…

1 month ago