The New York Times: OpenAI stellt KI vor, die sofort eindrucksvolle Videos generiert

In April, a New York start-up called Runway AI unveiled technology that lets people generate videos, like a cow at a birthday party or a dog chatting on a smartphone, simply by typing a sentence into a box on a computer screen.

The four-second videos were blurry, choppy, distorted, and disturbing. But they were a clear sign that artificial intelligence technologies would generate increasingly convincing videos in the months and years to come.

Just 10 months later, the San Francisco start-up OpenAI has unveiled a similar system that creates videos that look as if they were lifted from a Hollywood movie. A demonstration included short videos — created in minutes — of woolly mammoths trotting through a snowy meadow, a monster gazing at a melting candle and a Tokyo street scene seemingly shot by a camera swooping across the city.

OpenAI, the company behind the ChatGPT chatbot and the still-image generator DALL-E, is among the many companies racing to improve this kind of instant video generator, including start-ups like Runway and tech giants like Google and Meta, the owner of Facebook and Instagram. The technology could speed the work of seasoned moviemakers while replacing less experienced digital artists entirely.

This video’s A.I. prompt: “Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people enjoying the beautiful snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind along with snowflakes.”
Source: OpenAI

It could also become a quick and inexpensive way of creating online disinformation, making it even harder to tell what’s real on the internet.

I am absolutely terrified that this kind of thing will sway a narrowly contested election.
– Oren Etzioni, a professor at the University of Washington who specializes in artificial intelligence. He is also the founder of True Media, a nonprofit working to identify disinformation online in political campaigns

OpenAI calls its new system Sora, after the Japanese word for sky. The team behind the technology, including the researchers Tim Brooks and Bill Peebles, chose the name because it “evokes the idea of limitless creative potential.”

In an interview, they also said the company was not yet releasing Sora to the public because it was still working to understand the system’s dangers. Instead, OpenAI is sharing the technology with a small group of academics and other outside researchers who will “red team” it, a term for looking for ways it can be misused.

This video’s A.I. prompt: “Animated scene features a close-up of a short fluffy monster kneeling beside a melting red candle. The art style is 3D and realistic, with a focus on lighting and texture. The mood of the painting is one of wonder and curiosity, as the monster gazes at the flame with wide eyes and open mouth. Its pose and expression convey a sense of innocence and playfulness, as if it is exploring the world around it for the first time. The use of warm colors and dramatic lighting further enhances the cozy atmosphere of the image.”
Source: OpenAI

The intention here is to give a preview of what is on the horizon so that people can see the capabilities of this technology — and we can get feedback.
– Tim Brooks

OpenAI is already tagging videos produced by the system with watermarks that identify them as being generated by A.I. But the company acknowledges that these can be removed. They can also be difficult to spot. (The New York Times added “Generated by A.I.” watermarks to the videos with this story.)

The system is an example of generative A.I., which can instantly create text, images, and sounds. Like other generative A.I. technologies, OpenAI’s system learns by analyzing digital data — in this case, videos and captions describing what those videos contain.

OpenAI declined to say how many videos the system learned from or where they came from, except to say the training included both publicly available videos and videos that were licensed from copyright holders. The company says little about the data used to train its technologies, most likely because it wants to maintain an advantage over competitors — and has been sued multiple times for using copyrighted material.

An A.I.-generated video by OpenAI created with the following prompt: “Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.”
Source: OpenAI

Sora generates videos in response to short descriptions, like “a gorgeously rendered papercraft world of a coral reef, rife with colorful fish and sea creatures.” Though the videos can be impressive, they are not always perfect and may include strange and illogical images. The system, for example, recently generated a video of someone eating a cookie — but the cookie never got any smaller.

DALL-E, Midjourney, and other still-image generators have improved so quickly over the past few years that they are now producing images nearly indistinguishable from photographs. This has made it harder to identify disinformation online, and many digital artists are complaining that it has made it harder for them to find work.

We all laughed in 2022 when Midjourney first came out and said, ‘Oh, that’s cute.’ Now people are losing their jobs to Midjourney.
– Reid Southen, a movie concept artist in Michigan

READ THE SOURCE

OpenAI stellt KI vor, die sofort eindrucksvolle Videos generiert

Newsletter

Informieren Sie sich über unsere neuen Entwicklungen & exklusiven Angebote