Skip to main content
  1. Home
  2. Computing
  3. News

Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

Jacob Roach
By
Nvidia revealing support for the Apple Vision Pro.
Nvidia

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Recommended Videos

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!
Privacy Policy

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors' Recommendations

Topics
Jacob Roach
Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
Vision Pro visors are cracking, and no one knows why
cracked vision pros not dropped and the mystery continues inphenite s pro has a long crack running top to bottom

Some Vision Pros have cracks in the middle, at the bottom of the front glass. Wohinbistdu and dornbirn / Reddit

The front glass of Apple's Vision Pro is cracking down the middle for a small, but growing number of people. The cause is a mystery because the owners say they didn't drop, mishandle, or abuse the headset in any way. After an outlier 18 days ago, several more owners have reported the same problem occurring in the past 48 hours.

Read more
Don’t believe the reports about people returning Vision Pros
Someone using Vision Pro at a demo in an Apple Store.

We all know that Apple’s Vision Pro is incredibly expensive -- $3,499 is a huge amount to pay for a mixed-reality headset, even if it is by far the best on the market. That has apparently led to some high-profile Apple fans returning their Vision Pros, and not just because of the price.

In his latest Power On newsletter, Bloomberg’s Mark Gurman says he spoke to over a dozen prominent Apple users who have recently sent their headsets back for a refund. The reasons they returned their products, Gurman says, fell along a few familiar lines.

Read more
I tried the Apple Vision Pro. Here’s why it won’t replace my iPhone
Christine wearing the Apple Vision Pro demo unit.

The Apple Vision Pro is one of Apple’s most fascinating new product launches. It’s the first new product line from Apple since the Apple Watch, but the hype around it has been more like when Apple first introduced the original iPhone. Of course, Apple was not the first to the market with a VR/AR headset, but it is definitely what would be considered the most “mainstream” option out there, considering the brand name.

When Apple announced the Apple Vision Pro on June 5, 2023, during its WWDC 2023 keynote, I was excited. After years of rumors, it was finally happening. Preorders started on January 19, 2024, and the  Apple Vision Pro launched on February 2, 2024, in the U.S. The problem? It costs at least $3,500, making it a hard sell for many as a first-generation Apple product.

Read more