Adobe brings content-aware fill for videos to After Effects
Adobe today announced that it is bringing content-aware fill to After Effects, the special effects software that is part of its Creative Cloud offering. The company has long offered this feature in Photoshop, where you can use it to automatically remove objects from a photo, with the application filling in the blank space with appropriate pixels, based on what’s around it. As you can imagine, doing this for a video is significantly harder because you have to do this for every image while the objects move.
The company notes that this new feature is powered by Adobe Sensei, the company’s AI platform. To remove an object (or maybe a stray boom mic) from a scene is to mask it. If everything works as planned, the tools will automatically track the object through a scene (even when it moves behind another object for a bit) and replace it with more suitable pixels. If you need to fine-tune the result, you can also use Photoshop to create reference frames.
Adobe notes that content-aware fill is also a very useful tool for 360-degree VR projects, where you can’t always hide everything around the camera …Read More
Adobe’s new After Effects tool allows users to remove objects from footage
The tool is now available to all Adobe Creative Cloud subscribers who are on the 16.1 Spring update. — Adobe
Adobe has added the content-aware fill tool to the latest version of Adobe After Effects in the 16.1 Spring update.
The feature was originally a tool only available in Photoshop and was meant to be used for still images, which is why some who are familiar with Photoshop may recognise the name.
Similar to how it works in Photoshop, the After Effects version of the tool enables users to remove certain unwanted objects from their footage, but in the After Effects version, the tool uses Adobe’s machine learning AI called Sensei to track the objects’ movements.
Previously, users would have to get third-party plugins like Mocha Pro to track and remove objects in After Effects. With the new content-aware fill, that functionality is built-in to After Effects, and all users need to do is to create masks at the beginning, middle, and end of the footage, then have the Adobe Sensei AI handle the in-between tracking… read more
Adobe After Effects Now Lets You Remove Objects from All Frames of Video At Once
Photoshop’s content-aware feature is now available for videos in Adobe’s After effects as well, as per the latest update. This will let users remove unwanted objects from the videos, and with the use of Adobe Sensei machine learning, you will not have to remove it in every frame.
Content-aware so far has been removing unwanted objects from the still images, whereas now objects will be removed from the moving scenes and will fill in the missing pixels automatically.
In 2017, this feature was first displayed as an experimental at Adobe Sneak with the name Project Cloak. Now the Creative Cloud subscribers also have access to this tool. This could be a good option in post-production editing as for removing the boom mics or eliminating people or other irrelevant objects if they come into the final shot.
Adobe has also introduced certain updates for their other video and audio editing software, some of which will be making use of Adobe Sensei. Artificial intelligence is being used by auto-ducking for Ambience which will analyze seamless mix in the audio clips in Adobe Audition and Premiere Pro. Also, clips would be organized and a better storyboard would be built with the use of a new Freeform View in Project Panel. Puppet rigging will also improve with the Adobe Character Animator, “you can apply behaviors, tag layers, and search through puppet rigs, allowing you to work faster and create more refined performances.” …read more