Rotoscoping in Real-Time using Machine-Learning / AI

Happy Friday 3D e VFX Artists, today I want to speak to you about the new video that appeared on the web a few days ago, which shows how to achieve real-time rotoscoping using the power of Machine Learning.

How to made roto, using Machine-Learning / AI… can we say Goodbye to Green Screen?

In the video we see the simplicity and speed of how to make the roto from the footage, in the video, we see the Rotoscoping of 3 videos in 10 minutes using Machine-Learning / AI. Can we say that the roto artist’s work is questioned? and what is the future of this technology?

Today there are several online tools that help us with rotoscoping using Machine-Learning / AI, here are some of them:

Runwayml
www.runwayml.com

You can cut anything from all your videos …
Runwayml Green Screen is a web tool that helps you crop, instantly crop objects from your videos, with a simple click

Also, Unscreen is another online  based platform where you can generate the roto for your footage:

Unscreen
www.unscreen.com

100% Automatically, without a single click
No need to pick pixels, select colors, paint masks or move paths: Unscreen analyzes your video 100% automatically and generates a high-quality result. Simple, good.

Can we say that the roto artist’s work is questioned?

Honestly, I think the web is probably the least interesting platform for this sort of thing, these products are great for creating videos for youtube or social media.

Maybe for well-lit scenes and slow movements, these tools would be absolutely fine even now, but in my opinion, we need a few more years to make it the main tool.

What is the future of visual effects?

On the other hand, if we want to work at higher levels, a tool that I recommend to speed up the roto work is the new auto-rotoscoping feature works on DaVinci Neural Engine and works by working on color grading.

Magic Masks in Resolve
/magic-mask-in-davinci-resolve-17/

Magic Mask has specific controls that you can set based on what you want to mask. It has a setting to quickly select an entire person or particular features such as the face, legs, clothes or arms.

Nuke auto-rotoscoping feature?

I think in the near future it would be interesting how Nuke will use AI technology in rotoscoping, if the technology eventually becomes just a node in Nuke, it will be thousand times more interesting.

Also, check this video about VFX Artists compete against artificial intelligence, using After Effects and Mocha Pro for Rotoscoping, how to speed up the roto job.

I’m curious to hear everyone’s thoughts on this new tech! write in the comments what you think!

Privacy Preference Center

Necessary

3DArt.it utilizza Cookie per salvare le preferenze di navigazione ed ottimizzare l'esperienza di navigazione dell'Utente. Fra questi Cookie rientrano, ad esempio, quelli per impostare la lingua e la valuta o per la gestione di statistiche da parte del Titolare del sito.

3DArt.it utilizza Cookie per salvare la sessione dell'Utente e per svolgere altre attività strettamente necessarie al funzionamento di www.3dart.it ad esempio in relazione alla distribuzione del traffico.
Google Analytics è un servizio di analisi web fornito da Google Inc. (“Google”). Google utilizza i Dati Personali raccolti allo scopo di tracciare ed esaminare l’utilizzo di 3dart.it, compilare report e condividerli con gli altri servizi sviluppati da Google. Google potrebbe utilizzare i Dati Personali per contestualizzare e personalizzare gli annunci del proprio network pubblicitario. Questa integrazione di Google Analytics rende anonimo il tuo indirizzo IP. L'anonimizzazione funziona abbreviando entro i confini degli stati membri dell'Unione Europea o in altri Paesi aderenti all'accordo sullo Spazio Economico Europeo l'indirizzo IP degli Utenti. Solo in casi eccezionali, l'indirizzo IP sarà inviato ai server di Google ed abbreviato all'interno degli Stati Uniti. I servizi contenuti nella presente sezione permettono al Titolare del Trattamento di monitorare e analizzare i dati di traffico e servono a tener traccia del comportamento dell’Utente. Google Analytics con IP anonimizzato (Google Inc.)
How Google uses cookies

Advertising

Analytics

Other