Apple Vision Pro Upgraded with Enhanced Features in visionOS 2

Introducing visionOS 2 for Enhanced User Experience

This week, Apple has unveiled visionOS 2, a substantial update to its Vision Pro spatial computing headset. The upgrade includes new features that optimize mixed reality (MR) capabilities like enhanced spatial capture, improved hand-tracking, refined productivity tools, enriched virtual environments, and evolved avatar personalization.

Boosting Productivity

The visionOS 2 update brings several productivity improvements, aimed at simplifying the user experience for professional applications. Notable enhancements include the integration of physical mouse support and Magic Keyboard optimization, ensuring that the physical keyboard’s location is unveiled even in virtual surroundings. Moreover, real-time transcription is now available through a Live Captions mode, enhancing communication by transcribing speech, audio, and video contents.

The Look to Dictate feature has also been upgraded for use in the Messages app, promising faster response times. Apple has announced additional updates, set to arrive later this year, focusing on Mac Virtual Display enhancements.

Advanced Spatial Capture

In visionOS 2, the spatial recording feature has been fine-tuned to allow users to capture and view 3D recordings on both Vision Pro and iOS devices. Additionally, machine learning algorithms now elevate the quality of these captures. Similarly, 2D images can be converted into 3D spatial photos, enriching visual content creation.

Apple’s recent launch of the iPhone 16 Pro and 16 Pro Max, equipped with the A18 Pro chip, extends spatial recording capabilities to these devices. The Vision Pro’s SharePlay feature has been updated to facilitate the shared viewing of spatial content, and the Vision Pro Photo app now boasts an enhanced layout and advanced editing tools. Canon is also gearing up to release a spatial capture lens for its EOS R7 digital camera, which indicates a broader move towards professional-grade spatial recordings.

Personalized Avatars

The updated Persona avatar system in visionOS 2 delivers more lifelike skin tones, varied clothing colors, improved hand gestures, and additional virtual backgrounds for video calls on platforms like FaceTime and Microsoft Teams. SharePlay extends its functionalities to Persona, enabling group viewing of spatial recordings with friends or colleagues.

Enhanced Hand and Eye Tracking

The Vision Pro’s unique controller-less design, which relies on hand and eye-tracking inputs, has been further refined. Users can now access the home screen, adjust volume, and perform other tasks using new hand gestures. Furthermore, the device can store recent guests’ hand and eye data for 30 days, facilitating repeated interactions.

Looking Forward

Apple plans to roll out more updates before the end of 2024. As part of its future roadmap, Apple is reportedly working on making its MR technology more accessible. There’s talk about an affordable spatial computing device, a second-generation Vision Pro, and straightforward smart glasses. The Vision Pro is also expanding its availability to international markets.

Source: https://www.xrtoday.com/mixed-reality/visionos-2-enhances-apple-vision-pro-features-spatial-capture-avatars-hand-tracking-virtual-environments/

This article is experimental and made by Knoxlabs AI.