Netflix Uses AI To Go Beyond Green Screen Visual Effects – Decryption

Spread the love

Netflix researchers say they may have made the ubiquitous green screen obsolete. Described as a revolutionary advance in the application of AI in the film and television industry, Magenta Green Screen (MGS) harnesses the power of artificial intelligence to enhance visual effects, making them more realistic and accurate in real time. .

The streaming giant’s new technology is an impressive addition to the company’s diverse arsenal, which already employs deep learning to tailor the user experience. Using AI, Netflix has made a name for itself by successfully profiling users and suggesting content to viewers. AI has also helped Netflix create compelling highlights, recaps and trailers to grow viewership.

Green screen technology is a widely used process in which an actor is shot against a bright green background, which can later be digitally removed and replaced. This process can be automated, but problems arise when green elements appear in the foreground or when small details like hair or transparent objects are involved. To address these issues, operators often manually adjust settings or paint on each frame, a time-consuming process.

Netflix says MGS leverages AI to achieve better results than traditional green screens in a fraction of the time it normally takes to edit a scene.

How Netflix uses AI to improve VFX games

In the MGS method, the actor is shot under bright green LEDs, and red and blue LEDs are illuminated from the front, giving them a magenta glow. This unique lighting configuration creates separate red, green and blue channels. The green channel only records the background, so the foreground appears black, while the red and blue channels only capture the foreground, and the background appears black.

By introducing AI into this system, the green channel can be replaced in real time, allowing actors to be realistically and instantly placed in the foreground of another scene. More notably, this AI technology can now accurately handle intricate details like transparent objects and individual hairs that were difficult with traditional methods.

The use of AI is not limited to the shooting stage. Netflix also employs AI to restore the full spectrum of foreground colors, as actors and objects can be magenta with MGS technology. This is achieved by using a normally lit reference photo of the actor.

Netflix is ​​just one of many companies riding the AI ​​wave. Other startups and unicorns are leveraging the use of AI technology to improve user profiles, deliver better customer experiences, and optimize their products.

As Decryption As recently reported, Zoom has developed a meeting summarizer using GPT. Also Meta is using generative AI to create better ads, Google is improving its office suite thanks to its own LLM, and even the US Department of Defense has an interesting use of AI as a strategic tool. I’m trying to come up with an example.

Despite the complexity associated with MGS technology, Netflix believes in the potential of AI-powered GS systems. But other companies in the industry are also concerned.

Drew Rahat of video production company Geiger Post expressed concern about the technology’s practicality in the fast-paced filming environment and its competitiveness with other emerging methods. “It may work well in a fully controlled space, but it will have to compete with other new technologies, such as virtual production stages, to convince producers in real-world scenarios,” he said. I was.

Nevertheless, as Netflix researcher Paul Debebek told New Scientist, “computers already provide powerful tools that make a lot of things easier. [This is] Another thing we can easily do is allow the talented artists we have to focus on artistry and actually make things look better. “

Netflix is ​​betting on AI not only to improve the viewer experience, but also to streamline the work behind the scenes. Writers may hate AI creeping into their business, but do VFX artists feel the same way?

#Netflix #Green #Screen #Visual #Effects #Decryption

Spread the love

Leave a Comment