Sony has planned to collaborate with developers of a variety of 3D production software, including in the entertainment and industrial design fields.
Sony Corporation has announced the development of a spatial content creation system, featuring an XR head-mounted display equipped with high-quality 4K OLED Microdisplays and a video see-through function. The system also includes controllers optimised for intuitive interaction with 3D objects and precise pointing. Geared towards supporting creators in advanced 3D content creation, Sony plans to collaborate with developers in various fields, including entertainment and industrial design.
In an exclusive partnership with Siemens, a leading figure in industrial technology, Sony aims to introduce a solution for immersive design and collaborative product engineering. This venture leverages software from the Siemens Xcelerator open digital business platform.
The anticipated system is scheduled for release later in 2024. Sony, along with its partners, will provide further details, including specifications, launch date, regions of availability, pricing, sales channels, and software compatibility.
The spatial content creation system boasts an XR head-mounted display with 4K OLED Microdisplays and Sony’s proprietary rendering technology. This combination facilitates real-time, high-definition rendering of 3D objects and realistic facial expressions. With video see-through functionality, spatial recognition through six cameras and sensors, a ring controller for intuitive manipulation of virtual objects, and a pointing controller for precise actions, the system offers an immersive and intuitive platform for creators.
Utilising the Snapdragon XR2+ Gen 2 Platform by Qualcomm Technologies, Inc., the system’s processor ensures good image quality and supports user and space tracking for seamless XR experiences. Sony’s spatial content creation system aims to bridge the gap between the physical and virtual realms, providing an immersive tool for the entire creative process, supporting real-scale 3D models, and enabling remote, real-time reviews through integration with third-party 3D creation applications.
Sony continues its commitment to empowering spatial content creators with technologies that enhance workflow and quality. Previous releases, such as the “mocopi” mobile motion capture system and Spatial Reality Displays, have already demonstrated Sony’s dedication to providing innovative solutions for immersive creative experiences in various fields.
Cedrik Neike, Member of the Managing Board of Siemens AG and CEO of Siemens Digital Industries, said: “Siemens is partnering with Sony to enable immersive engineering, a critical building block for the industrial metaverse. Together, we are creating an environment where it will be possible to experience the realities of physics, without the bounds of time to profoundly improve how our customers work and collaborate.”
Said Bakadir, Senior Director of Product Management of Qualcomm Technologies, added: “We designed our Snapdragon XR2+ Gen 2 to deliver 4K display resolution, cutting-edge graphics, and unparalleled performance to enable creators to build innovative spatial content that will transform all industries for the better. It’s exciting to see Sony enter the enterprise space with their spatial content creation system and utilise Snapdragon XR technologies to unleash more realistic, detailed, and precise Mixed Reality (MR)/VR experiences that will help developers and creators push forward an even more immersive future.”
The XR head-mounted display system features large-size, high-definition 1.3-type OLED Microdisplays with 4K resolution and a wide colour gamut covering up to 96% of DCI-P3. This system enables the detailed and realistic rendering of textures on 3D objects and human characters’ facial expressions, allowing creators to seamlessly navigate the entire modelling and review process while wearing the head-mounted display.
The system’s capability to support split rendering, distributing the rendering load between computers and the head-mounted display, ensures stable and high-definition rendering of large-size 3D models. In collaboration with Qualcomm Technologies, Inc., Sony is among the pioneers in adopting the latest Snapdragon XR2+ Gen 2 platform. This processor harnesses the potential of the 4K OLED Microdisplays, delivering stunning image quality, and incorporates on-chip AI for enhanced user and space tracking.
Equipped with a ring controller for intuitive manipulation of virtual objects and a pointing controller for stable and accurate pointing in virtual spaces, the system provides optimised shapes and button layouts for efficient and precise operations. Creators can model 3D objects using both controllers and a keyboard while wearing the head-mounted display. The display is designed for comfort and stability during extended creative use, with fine-tuned balance adjustments and pads made from materials that directly contact the user’s head.
The head-mounted display also features a flip-up mechanism, allowing creators to seamlessly transition between physical and virtual spaces without recalibrating the device when removing or wearing it. Sony aims to collaborate with various 3D production software developers in the entertainment and industrial design fields. At launch, an exclusive partnership with Siemens will introduce immersive engineering capabilities to the manufacturing industry, integrating with the new NX Immersive Designer software from the Siemens Xcelerator portfolio. This integration of hardware and software aims to empower creators in industrial design and product engineering, providing a more immersive design, review, and collaboration experience.
