Sony is set to introduce its innovative camera tracking system, OCELLUS (ASR-CT1), which is designed to transform the world of augmented reality (AR) and virtual production in both broadcast and cinema. This cutting-edge system simplifies camera tracking with marker-free technology, utilizing multiple sensors, and is fully camera-agnostic, meaning it can work seamlessly with both cinema and broadcast cameras, including those from other brands. The OCELLUS system is especially suited for virtual production applications, such as In-Camera VFX and AR, providing real-time camera position and orientation data while filming. This allows for smooth integration of live action with digital environments.
The OCELLUS system consists of three key components: a sensor unit, a processing box, and three lens encoders. It works effortlessly with a wide range of cameras, including Sony Cinema Line cameras, system cameras, and even non-Sony cameras. With Sony’s Visual SLAM (Simultaneous Localization and Mapping) technology at its core, OCELLUS creates an accurate reference map that enables stable marker-free tracking in both indoor and outdoor environments. The system’s five image sensors and infrared LEDs ensure tracking remains precise even in low-light conditions, with superior occlusion resistance that ensures accuracy despite potential obstructions.
When using Sony cameras, metadata like focus, iris, and zoom values can be captured directly via the camera’s SDI output and transmitted in real-time through an Ethernet cable. If the lens doesn’t support direct metadata extraction, additional lens encoders can be attached to collect the necessary data. This metadata is vital for AR and virtual production, and the system even supports the recording of tracking data, timecode, and file names, making post-production workflows more streamlined and efficient.
Sony’s ongoing commitment to supporting creators in the Virtual Production and AR fields extends across its complete suite of tools, ranging from acquisition to display, with products like the Crystal LED VERONA display screens and the Virtual Production Toolset software.
OCELLUS features a compact sensor unit with five high-performance image sensors, four of which are actively used for stable, marker-free tracking with exceptional resistance to occlusions. The unit includes IR LEDs for low-light tracking and a Visible Light Cut Unit for consistent performance even in rapidly changing lighting conditions. It is compact, measuring just 86 mm × 60 mm × 43 mm and weighing only 250 g, and can be easily installed using NATO rail mounts. The system is powered via a single USB Type-C® cable, which also transmits the tracking data to the processing box. The processing box transmits real-time data and camera/lens metadata to CG rendering software, like Unreal Engine, over Ethernet. It is equipped with Genlock and Timecode inputs, SDI inputs/outputs, and lens encoder connection terminals. The box can also record tracking data and camera/lens metadata as FBX files onto SDXC cards, synchronized with video files.
The lens encoders measure precise rotations of lens focus, zoom, and iris values and transmit the data to the processing box via a LEMO 7-pin cable. This setup ensures metadata acquisition for lenses and cameras that don’t natively support SDI metadata embedding. The encoders come with five different gears, making them compatible with various lenses.
OCELLUS will be on display at the NAB (National Association of Broadcasters) Show 2025 in Las Vegas, USA, starting on April 6, 2025, at the Sony booth. The system will become available for purchase in Malaysia beginning in Q4 2025. For more information, you can visit the official Sony website at Sony Pro Malaysia.
This version retains the core technical details while creating a smooth, narrative flow for easier reading. Let me know if you’d like to make further edits!