Sony takes advantage of artificial intelligence to facilitate video production

The new Edge Analytics Appliance, powered by AI machine learning technology, provides organizations with a cost-effective and autonomous way to create and enhance engaging video content.

With the goal that users can create video content in real time without the need for specialized training or additional personnel or equipment, Sony lanza REA-C1000, your first solution Edge Analytics based on artificial intelligence.

The compact and lightweight REA-C1000 uses a technology of video analysis based on artificial intelligence to analyze the content received from connected cameras and automatically isolate the object in focus to combine it with other images in real time using a GPU (graphics processing unit).

This technology combines facial and motion detection with shape and color recognition to turn the REA-C1000 into the powerful brain of any connected camera and audiovisual setup. This allows organizations in the educational, government and corporate sectors to create professional content in a cost-effective way that keeps their audiences engaged.

Kenji Izu, head of strategic marketing at Sony, comments that “Video content has become a key method of communication in many organizations, including educational, government and corporate environments, and demand for solutions to create high-quality content, offer a hassle-free recording experience and help distribute content quickly is on the rise.”

"At Sony we want to offer organizations on tight budgets cost-effective yet powerful solutions that allow them to easily create professional and engaging video content. The REA-C1000 is another example of Sony's collaboration with our audiovisual partners in the business, education and government sectors to together create solutions that help address the real technological and financial challenges of our customers," he adds.

Main functions

REA-C1000, which will be available in spring, includes features such as handwriting extraction, speaker overlay, chroma keyless CG overlay, automatic control of output images (such as PTZ auto tracking), focus area cropping, and gesture zoom.

By optimizing parameters and processing images received from the camera, the REA-C1000 is capable of extracting handwritten objects on white or black boards through Sony's still and moving object detection algorithm. This allows viewers to clearly see the written content and outlines without missing the speaker's gestures and expressions. This feature of the REA-C1000 is especially useful in auditoriums or distance learning sessions when it comes to keeping students' attention even if they are not in the same room as the teacher. Additionally, it helps generate audience interest for a live presentation in a large room that requires secondary monitors.

As for the chroma keyless CG overlay, this feature based on Sony's motion detection technology is capable of isolating the speaker and superimposing them on any background without the need for a dedicated backdrop or specialized knowledge. This provides a simple and cost-effective chroma key solution to create much more interesting and engaging corporate videos, interviews, webinars or e-Learning materials. This feature will be available in a future software update in late 2019.

REA-C1000 can accurately and fluidly follow a speaker captured from a PTZ camera and ensure it remains framed and in focus throughout the presentation. This feature provides users with a cost-effective tracking solution for educational, business or conference environments without having to invest in a camera operator.

In what focus area cropping, thanks to this function, it is possible to simultaneously display the image from a camera as two different output images. Users will be able to see a general image in 4K and another cropped one in HD. The cropped area can be selected as a static or dynamic image (to follow the speaker's movement). This feature will be available in a future software update in late 2019.

Also note that this solution can detect and react to audience gestures, allowing both the full image and the enlarged version to be displayed in real time.

When an audience member stands up, the REA-C1000 can trigger the camera to zoom in on that person automatically, which is especially useful in educational settings to analyze student reaction, as well as in certain types of corporate presentations, such as question and answer sessions.

After an initial 60-day free trial, each feature can be permanently activated through separate licenses, allowing users to freely customize the features they need based on their needs and budget.

Sony has applied its image quality know-how and camera development experience to the REA-C1000 to offer 4K/HD input and output and direct connection capability to PTZ cameras, including its range of XDCAM camcorders, which boast outstanding image quality and widespread use in the broadcast sector. Additionally, thanks to its HDMI network connection, the REA-C1000 can be seamlessly integrated into a variety of common multi-monitor audiovisual setups, projections on large screens with monitors, or even live broadcast projects.