Skip to content

Magic Leap and NVIDIA: The Partnership Revolutionizing Digital Twins in AR

13/04/2023

Magic Leap, in collaboration with NVIDIA, has made a breakthrough by developing immersive and photorealistic ray-traced digital twins. This strategic partnership aims to provide efficiency and value in various sectors, such as engineering, architecture, retail and more.

Enabling autonomous computing in Magic Leap 2

Magic Leap has partnered with NVIDIA to enable autonomous computing and streaming. 3D models at 1:1 scale in their augmented reality headset, Magic Leap 2. Thanks to this collaboration, business users can render and stream large-scale digital twins immersively from the platform NVIDIA Omniverse to Magic Leap 2 without compromising picture quality. In addition, an extension has been developed that integrates business simulation programs in the user interface.

Error 403 The request cannot be completed because you have exceeded your quota. : quotaExceeded

Technical advances and outstanding features

The partnership between Magic Leap and NVIDIA has achieved significant technical advances, including:

  1. Ray tracing and Deep Learning Super Sampling (DLSS): These technologies allow you to reproduce content with exceptional detail and photorealistic quality.
  2. Magic Leap Dynamic Dimming Technology: Removes 99,7% of ambient light from the screen, allowing augmented reality to be used in various lighting conditions. lighting.
  3. Accurate Ambient Lighting and Digital Content Viewing: Provides an immersive experience by ensuring realistic lighting and accurate reflections.
  4. Depth-Based Reengineerability: Eliminates latency and enables permanent embedding of digital content into the user's environment.

Efficiency in 3D design and modeling

To improve the efficiency in the design and 3d modeling, as well as to allow the the most disruptive and professionals create accurate, photorealistic digital duplicates in Magic Leap 2, the Magic Leap Omniverse extension has been created. This extension plays content in tiempo real from the most common business modeling tools, such as Autodesk Maya, without the need for conversion or optimization. Content is stored in Omniverse Nucleus as USD files, where users can edit and collaborate in real time.

Streaming and remote rendering

Clicking "View in Magic Leap", the image is rendered on the server and instantly transmitted to Magic Leap 2, where it is displayed to the user in the correct position, orientation, and scale. Omniverse's flagship XR extension automatically generates high-quality stereo images and sends them over the API Industry standard OpenXR.

The OpenXR remote rendering server uses the acceleration of NVIDIA GPUs to combine and encode the stereo images, which are then transmitted over the network, received, decoded and displayed on Magic Leap 2. In addition, Magic Leap 2 continuously sends information about head position, eye tracking, controller status and other inputs to the server, allowing collaboration in real time and instant display of changes made to USD content.

Advantages and disadvantages

Advantages:

  1. Rendering and streaming immersive of large-scale digital twins.
  2. Exceptional photorealistic quality and detail thanks to ray tracing and DLSS.
  3. Versatile use in various lighting conditions with dynamic dimming technology.

❌ Disadvantages:

  1. Early Access: The integration Magic Leap with Omniverse is currently in early access, limiting its general availability.
  2. Technical requirements: Implementing digital twins in enterprise environments may require infrastructure and Results suitable technicians.

FAQs

How does the partnership between Magic Leap and NVIDIA benefit enterprise users?

The partnership between Magic Leap and NVIDIA enables business users to render and broadcast large-scale digital twins in an immersive way, speeding development, fostering collaboration, and transforming design reviews and other experiences.

What featured technologies are used in the collaboration?

Featured technologies include ray tracing, Deep Learning Super Sampling (DLSS), Magic Leap's dynamic dimming technology, and depth-based reengineering capability.

What are the benefits of the Magic Leap Omniverse extension?

Magic Leap's Omniverse extension enables real-time playback of content from common enterprise modeling tools, such as Autodesk Maya, without the need for conversion or optimization.

When will the integration between Magic Leap and Omniverse be available?

The integration is currently in early access, with a general release expected in the first half of this year.

How do you achieve remote streaming and rendering in Magic Leap 2?

Remote streaming and rendering is achieved through the use of video acceleration. GPU from NVIDIA, which combines and encodes stereo images for transmission over the network.

This exciting advancement in immersive, photorealistic digital twins powered by Magic Leap and NVIDIA opens up new possibilities for businesses across multiple industries. As technology evolves and refines, digital twins are expected to play an increasingly relevant role in design, collaboration and business transformation.

April 12, 2023 - magic jump announced that coopera with NVIDIA pioneered immersive, photorealistic ray-traced digital twins at NVIDIA omniverse platformto create new efficiencies and value in engineering, architecture, retail and other industries.

Magic Leap partnered with NVIDIA to find a way to enable autonomous computing and streaming of 3:1 scale 1D models to its Magic Leap 2 augmented reality (AR) headset. According to Magic Leap, the collaboration enables enterprise users immersively render and stream large-scale digital twins from the NVIDIA Omniverse platform to Magic Leap 2 with no image quality degradation and includes an extension that integrates common business simulation programs into the user interface.

Technical advances that companies have worked on include:

  • Ray tracing and Deep Learning Super Sampling (DLSS), which allows content to be reproduced with great detail and photorealistic quality;
  • Magic Leap's dynamic dimming technology, which removes 99,7% of ambient light from the screen so AR can be used in a variety of bright lighting conditions;
  • Precise ambient lighting and display of digital content;
  • Depth-based re-engineering capability that eliminates latency and permanently embeds digital content into the user environment.

To help make 3D modeling and design more efficient, and to enable businesses and professionals who create, design, and collaborate to recreate physically accurate, photorealistic digital duplicates on the Magic Leap 2 device, Magic Leap created the Omniverse Extension, which plays content on the headset of common enterprise modeling tools, such as Autodesk Maya, without the need for conversion or optimization. Content is stored in Omniverse Nucleus as USD files. In Nucleus, users can edit and collaborate on live content.

By simply clicking 'View in Magic Leap', the image is rendered on the server and transmitted to Magic Leap 2, where it is instantly displayed to the user in the correct position, orientation and scale. Omniverse's core XR extension automatically generates high-quality stereo images and sends them to the industry-standard OpenXR API.

The OpenXR remote rendering server environment then uses NVIDIA GPU acceleration to combine and encode the stereo images. These images are then transmitted over the network where they are received, decoded, and displayed on Magic Leap 2.

Magic Leap 2 also continuously sends head positions, eye tracking, controller status, and other input to the server, from where it's streamed to Omniverse via OpenXR. On the backend, other users can continue to edit live USD content, with changes instantly replayed and streamed to Magic Leap 2.

Thanks to NVIDIA Omniverse, Magic Leap users can see photorealistic ray-traced AR.

Magic Leap said that by leveraging a number of features from Magic Leap 2 and NVIDIA RTX GPUs, the fix helps mitigate common issues, including:

  1. Reprojection reduces latency and locks content in place: Magic Leap 2 can support over 100 milliseconds of end-to-end latency while maintaining a user experience immersive;
  2. NVIDIA RTX ray tracing and DLSS provide photorealistic quality;
  3. Dynamic dimming technology makes content opaque and adds behaviorally realistic shadows;
  4. Precise ambient lighting and reflections ensure immersion. The company added that it is actively exploring ways to make the feature even more realistic with dynamic lighting evaluation.

Magic Leap said it will continue to work with NVIDIA and leverage its advances in digital twin technology to deliver greater value to enterprise users. With more immersive and accessible digital twins, equipment They can accelerate development, deepen collaboration, and transform design reviews and other experiences.

Magic Leap's integration with Omniverse is currently in Early Access, with a general release expected in the first half of this year. To learn more about working with Magic Leap to implement digital twins in the company and business, click here.

Image Credit: Magic Leap




READ MORE ARTICLES ABOUT: VR News.

READ THE PREVIOUS POST: Bandai Namco Entertainment: Investments in AI and the Metaverse of the Future.

Related Posts

Comments are closed.

Comments (23)

Do we really need more technology in our lives or is it enough? 🤔

Incredible collaboration between Magic Leap and NVIDIA! What do you think about autonomy in AR?

Are Magic Leap and NVIDIA really the perfect couple to revolutionize AR? Interesting!

Will the future of augmented reality be as bright as they paint it? 🤔

Incredible integration of Magic Leap and NVIDIA! Will it be the future of augmented reality? 🚀

Without a doubt a powerful combination! But let's not forget that technology advances by leaps and bounds. Will Magic Leap and NVIDIA be the definitive formula for augmented reality? Only time will tell. Exciting future awaits us! 🌟

Will it really be a game-changer or just another fad? Opinions please. 🤔👾

I hope it is a real change and not just another fad. Evolution is necessary in the video game industry to stay relevant. Only time will tell if this new approach endures or is forgotten. Let's keep an open mind and enjoy the process. 👾🎮

Do we really need more technology in our lives or do we already have enough? 🤔

Interesting collaboration between Magic Leap and NVIDIA! What news will it bring us in AR? 🤔

It looks like the future of augmented reality is getting interesting. Hopefully this collaboration will bring us significant innovations. We will be attentive to see if they meet expectations! Thanks for sharing the news!👀🔮

What an alliance between Magic Leap and NVIDIA! What will the next revolution in AR hold for us?

Can you imagine a future where our digital twins are more real than us? 🔮✨

Amazing how augmented reality is evolving! Will it really be as impressive as they promise? 🤔

How about we explore how this reinvents virtual reality? Incredible! 🚀👾

Will Magic Leap and NVIDIA change the game in AR? Interesting! 🤔🔮

I don't believe it! Both companies have potential, but the AR market is complicated. The competition is fierce and the technology still has a lot to prove. It will be interesting to see how they evolve, but changing the game will be a challenge.🤨🔍

Incredible collaboration between Magic Leap and NVIDIA! Will there be competition for Hololens?

Amazing to see how technology advances in AR! Is it really the future? 🤔🚀

Do you really think this partnership will change the game in AR? Let us know your opinion!

I don't think this partnership will be a game changer in AR. There are many variables at play and no guarantees of success. It will be interesting to see how it develops, but I'm not getting my hopes up. Thanks for asking!

The fusion of Magic Leap and NVIDIA in AR is incredible! Will it be the future? 🚀

Can you imagine rendering remotely with Magic Leap and NVIDIA? Incredible! What do you think? 🤯