Apple's visionOS 26.4 introduces PC VR foveated streaming to Apple Vision Pro, revolutionizing wireless VR remote rendering. This feature, distinct from foveated rendering, focuses on sending higher-resolution visuals to the headset. It's inspired by Valve's Steam Frame, a feature in PC VR streaming via USB adapter. The new framework is a low-level, host-agnostic solution, compatible with local PCs and Nvidia's CloudXR SDK. This marks Apple's first use of the industry-standard OpenXR API, showcasing its versatility. The feature is a game-changer for VR streaming, especially with ALVR for Apple Vision Pro, now supporting PS VR2 controllers. The developer Max Thomas aims to add foveated streaming support, though it's a challenging task. Apple's approach could even enable foveated rendering for tools like ALVR. VisionOS's privacy-focused design, which doesn't reveal user gaze, is crucial for foveated streaming's success. The API provides the 'rough' region of the frame the user is viewing, allowing for higher-resolution rendering in that area. This innovation promises to enhance VR gaming and experiences, with potential applications in enterprise and beyond.
