Adobe has previewed a new generative AI upscaler called VideoGigaGAN that is capable of upscaling low-resolution and blurry videos up to eight times.
In a paper published by Adobe on April 18, VideoGigaGAN is revealed to be an impressive upscaler apparently achieving incredible results on terrible source imagery.
2/ Close-up shot of Eyes pic.twitter.com/Enk69ikT5H
— Linus ●ᴗ● Ekenstam (@LinusEkenstam) April 22, 2024
6/ Waterfall and foliage pic.twitter.com/hKLhSIByBw
— Linus ●ᴗ● Ekenstam (@LinusEkenstam) April 22, 2024
Adobe says that VideoGigaGAN is superior to other video super-resolution methods because it avoids strange AI artifacts and produces more fine-grained details. Built upon the large-scale upscaler GigaGAN, it improves the temporal consistency of unsampled videos by adding temporal modules and enhancing techniques.
The Verge notes that Generative Adversarial Networks (GANs) are great for upscaling still images but have not proven effective on video; producing unwanted flickering. There are other upscaling methods but they don’t produce as nice of a result as GANS.
Adobe showed off several examples where it used 124×124 video and upscaled it to 1024×1024 with the results definitely impressive and difficult to tell that AI has worked its magic.
Post by @luokai
View on Threads
For now, VideoGigaGAN is just a research preview with no immediate plans to bring it to Premiere Pro or its Creative Cloud suite. It follows the news that Microsoft is also developing an AI super resolution for Windows 11 called Automatic Super Resolution.
Adobe and AI
This week, Adobe unveiled one of its most significant Photoshop updates ever built of the advancements made in the Adobe Firefly Image 3 Foundation Model. The third iteration of Firefly has just gone into beta and promises massive advancement to quality and control including higher-quality image generations, better understanding of prompts, and enhanced detail and variety.
The Firefly model powers into Photoshop’s Generative Fill, Generate Expand, and Generative Image.
“This massive new update to Photoshop takes creativity to unprecedented levels — whether you are a professional or brand new to Photoshop,” says Ashley Still, senior president of the Creative Product Group at Adobe. “Through new Firefly-powered features in Photoshop, we are bringing ideation and creation closer together and making images both more powerful and approachable so everyone can realize their creative vision.”