Adobe explores the limits of AI at IBC 2023 with Premiere Pro

The new beta versions of Premiere Pro and After Effects with new artificial intelligence (AI) processes are the main claims for the presence of Adobe in IBC 2023.

The IA is the absolute protagonist of the improvements of Premiere Pro thanks to solutions like Enhanced Speech, a solution to enable “faster” dialog cleanup. These improvements are not only limited to content, but the system can also correct the most common defects of a poorly placed micro, or the excessive background noise of a conversation. The improvement is completed with the new labeling of audio categories, which uses AI to determine which clips contain dialogue, which contain music, and which are audio effects or ambient noise. All these processes are executed in background to help editors save time on some of their most tedious tasks.

The new Premiere Pro beta presented at IBC 2023 also has improvements in the text based editing, which now includes detection of filler words like “ems” and “ehs” in dialogue. Likewise, Adobe boasts of “massive improvements” in the editor performance, since the timeline has multiplied its optimization x5 to facilitate the most demanding editing processes; of new color preferences and tone mapping; new settings on the panel Lumetri Color; better LUT management and rebinding; new project templates; custom export locations; a new metadata and timecode recording effect, or block marker selection, among other improvements.

After Effects also has a new beta focused on 3D workspaces, thus opening the door to a new way of designing in motion. These improvements translate into the ability to add depth and dimension to compositions; enable image-based lighting; the addition of a 3D renderer, or new possibilities to combine 2D and 3D in a composition. Additionally, Adobe has included in the popular tool a new AI model of the Rotoscopy Brush tool, with which it will presumably be easier to isolate overlapping edges, hair and transparencies.

Frame.io y Camera to Cloud

Since Adobe acquired Frame.io has been adding new improvements in its purpose of providing possibilities for creatives to work collaboratively without dependence on a physical location.

The tool has received improvements for IBC 2023 such as Frame.io Storage Connect, a solution that allows direct connection to storage AWS S3 with lightweight proxies available on Frame.io. Additionally, Adobe has confirmed the renewal of review and approval tools for creators who work with a wide range of assets and need to compare them. Through a new comparison view, users will be able to view video, audio, photos, design files and PDF assets with access to comments and annotations.

Adobe's news at IBC 2023 is completed with Camera to Cloud, a tool that streamlines connections between Frame.io and Creative Cloud and, currently, more than 200 camera systems. The latest equipment to join this long list are the Ninja and Ninja Ultra recorders from atoms; the new GFX-100 mirrorless camera Fujifilm, and the SeeMo and SeeMo Pro devices from Accsoon.