Ross unveils Vision[Ai]ry Ft, AI-powered facial tracking tool

Empresa canadense Vídeo Ross is looking to “redefine” the broadcast world with the launch of Vision[Ai]ry Ft, a face-tracking system that uses artificial intelligence (AI).

Visão[Ai]ry Ft is capable of detecting, locating and tracking the position of faces within the video stream directly from the camera. Ross’ solution uses the different facial positions to steer the pan, tilt and zoom axes of the robotic camera system, thus maintaining the desired framing of the face(s) in the image. This, according to the manufacturer, eliminates the need for a camera operator to manually adjust the position of the subject in the image.

Vision[Ai]ry Ft’s AI algorithm can recognize a diverse set of race, gender, and age data, as well as identify and locate faces as long as at least 50% of them are visible in the image. Moreover, its user interface offers a live display of the video with detected faces and the framing target, as well as status information, tracking controls, and framing template library. Ross also notes that damping and deadband settings allow the user to tailor the system to talent to maintain optimal framing and tracking, while eliminating unwanted movement.

Differences from traditional methods

Ross Vídeo highlights three points that make Visão[Ai]ry Ft different. First, the solution “reduces the workload” of camera operators by eliminating the need to manually correct camera positions to compensate for daily variations in seating position, posture, and actor height. In addition, framing adjustments can be saved in templates that can be automatically recalled with robotic presets to provide a hands-free camera workflow when combined with production automation solutions such as Ross’ OverDrive. Finally, the technology company emphasizes that, unlike other solutions, it is able to deliver “consistent, high-quality tracking.”

Karen Walker, vice president of Camera Motion Systems at Ross, assesses the development as follows: “We’ve been talking about how AI might be used in live production for a few years now, and I’m delighted to see Ross leading the way with Vision[Ai]ry, which represents an innovative and highly creative solution. Our customers consistently tell us they need to work more efficiently and rationalise their workflows – Vision[Ai]ry Ft meets these challenges head on and holds true to our philosophy of helping drive high impact, high efficiency productions.”