After Effects Content Aware

YOHAN

OG Staff
Staff member
Oct 23, 2018
103
123
43
23

Wanna share an update to the creative cloud that can be really useful for some editors.

Adobe said:
With the Content-Aware Fill feature, you can remove any unwanted objects such as mics, poles, and people from your video with a few simple steps. Powered by Adobe Sensei, this feature is temporally aware, so it automatically removes a selected area and analyzes frames over time to synthesize new pixels from other frames. Simply by drawing a mask around an area, After Effects can instantly replace it with new image detail from other frames.

The tool gives you the option to help get the fill to blend seamlessly with the rest of the image. The Content-Aware Fill panel contains various options to help you remove unwanted objects and fill transparent areas.
From my tests, it's working pretty well at removing logos/lower thirds from most WWE footage. Here's 2 test from NXT Takeover NY's bigger replay window:


Not an intrusive and complicated clip. The 2nd rope and mat are recovered pretty well. The ring skirt/LED is saved.


Here's a more intrusive version. WALTER's left boot is mostly recovered but the 2nd rope is visibly warped. The wrestling mat is mostly recovered but warped.


Very good test here.

In short, if the content aware tool doesn't need to do much work, it can do a decent to amazing job at recovering lost details for a 16:9 release. This obviously goes out the window for 2:39 release but could be usable for a 1:85 release.

If you're paying for the CC then this update is readily available. If you're pirating CC, then you will need to install a new version of AE.

Adobe said:
Important points and tips
  • You can select an area in a footage using using any method that creates transparency, including:
    • Mask
    • Rotobrush
    • Eraser tool
    • Keying method such as Keylight method
    • Keyframing
  • If you have 4K footage in an HD comp, use footage that is already scaled down via transcoding for better performance.
  • Remove more complicated items in sections. For example, you can remove a person and their shadow separately more effectively than removing both at once.
  • Smaller masks take less time to process over larger ones.
  • The feature might give different results for a complex moving texture like water or areas where there is varied light and texture.
  • If the mask is feathered, Content-Aware Fill blends in the filled region with the original content based on this alpha value (semi transparency). This is very useful when you use the panel, it causes a noticeable boundary between the filled region and the original content
  • Generate Fill Layer renders sequences of images that are placed in the Timeline. These files may take up considerable space on the hard drives, depending on the kind of footage, and duration of your sequence.
  • In certain cases, Content-Aware fill alone may be unable to remove object with precision. To improve results, create a reference frame and take it into Photoshop, and use the tools there to fine-tune the results.
  • At the time of shooting a footage, consider the background and the foreground of your composition to reduce editing time during post-production.
 
Last edited:

YOHAN

OG Staff
Staff member
Oct 23, 2018
103
123
43
23
What exactly was taken off. Looks more like just an upscale fix.
The replay lower third within the window is mostly gone. There’s still some artifacts left from not fully masking it properly.
 
  • Like
Reactions: sts

Paroxysm

Contributor
Oct 21, 2018
494
70
28
25
US
www.youtube.com
This new feature is awesome bit of a lengthy process if you do every clip I imagine cropping is probably still superior in a lot of instances but this could be a game changer for those moments when cropping hurts a scene, to add to the test here this is all 3 logo's removed hardly any glitches once you drop the fill layer underneath with a slight feather and the content tools alpha expansion up to around 12

 
  • Like
Reactions: YOHAN

Leelee

Administrator
Staff member
Oct 19, 2018
1,189
825
113
30

Wanna share an update to the creative cloud that can be really useful for some editors.



From my tests, it's working pretty well at removing logos/lower thirds from most WWE footage. Here's 2 test from NXT Takeover NY's bigger replay window:


Not an intrusive and complicated clip. The 2nd rope and mat are recovered pretty well. The ring skirt/LED is saved.


Here's a more intrusive version. WALTER's left boot is mostly recovered but the 2nd rope is visibly warped. The wrestling mat is mostly recovered but warped.


Very good test here.

In short, if the content aware tool doesn't need to do much work, it can do a decent to amazing job at recovering lost details for a 16:9 release. This obviously goes out the window for 2:39 release but could be usable for a 1:85 release.

If you're paying for the CC then this update is readily available. If you're pirating CC, then you will need to install a new version of AE.
Really like what it did with the Ronda clip. Going to try this later.
 
  • Like
Reactions: YOHAN

YOHAN

OG Staff
Staff member
Oct 23, 2018
103
123
43
23
Another thing I found was if the warping is too much, apply the content aware fill frame by frame instead of throughout the clip.
 
  • Like
Reactions: Paroxysm and Leelee