Magic Leap, a leading company in the field of cross reality (XR) systems, has recently published a groundbreaking patent titled "Cross reality system with map processing using multi-resolution frame descriptors" (US11967020B2). This patent addresses the core problem of efficiently comparing pictures in a cross reality system and finding their corresponding locations. By providing a solution to this problem, Magic Leap is set to revolutionize the XR industry.
The problem being tackled by this patent is the intensive computation required to compare image frames based on frame descriptors. Each frame descriptor has a limited number of bits, which can lead to ambiguity when multiple images of different scenes have similar descriptor values. This ambiguity creates difficulties in accurately matching frames and can result in latency during crucial computations such as localization.
Moreover, the number of frames in persisted maps increases with the scale of the environments, further complicating the process. A large-scale map may have numerous frames with similar descriptors, making it challenging to differentiate between different locations in the physical world. This computational overload not only affects the performance of XR systems but also hampers the realistic display of virtual objects.
Magic Leap's patent proposes a solution to these issues by employing multi-resolution frame descriptors. Different devices can utilize varying levels of detail when comparing pictures, depending on their computational power. This adaptive approach significantly reduces the computational burden and speeds up the comparison process, resulting in more accurate matches between image frames.
The world after the successful implementation of this patent will witness a seamless integration of virtual and real objects in XR systems. For instance, in scientific visualization, medical training, engineering design, and personal entertainment, users will experience virtual objects interacting with real-world elements with unparalleled realism. The XR systems will be capable of providing a more immersive user experience, as the local devices will be lighter, generate less heat, and have extended battery life.
Imagine a scenario where medical students can visualize complex anatomical structures directly overlaid on the patient's body, allowing for more accurate and efficient learning. In architecture and design, professionals can virtually place furniture or other objects in real-life environments, enabling clients to visualize their desired spaces accurately. The possibilities are endless, and Magic Leap's patent opens the door for these transformative experiences.
It is important to note that this is a patent, and its appearance in the market is not guaranteed. However, if implemented, this technology has the potential to reshape the future of XR systems, offering users unparalleled immersion and interactivity.
(P.S. This publication is about a recently filed patent, and there is no guarantee that the invention described here will become commercially available.)