visionOS 2.4: New Features Arriving with Vision Pro Update

Apple is set to enhance its Vision Pro operating system with the upcoming release of visionOS 2.4, introducing a host of new features that promise to enrich user experience. The update, currently in beta testing for developers, is anticipated to roll out in the coming weeks.

One of the most notable additions is the integration of Apple Intelligence, a feature that had left many wondering whether it would be compatible with the capabilities of the Vision Pro. Earlier speculation suggested that the M2 processor within the device might be too occupied managing spatial computing tasks like eye tracking and spatial mapping. However, visionOS 2.4 will incorporate Apple's AI system with essential functionalities ranging from writing tools to image generation capabilities.

Apple Intelligence is designed to operate much like it does in iOS, iPadOS, and macOS, with the initial beta supporting American English, while additional languages are expected to follow later this year. The writing tools available will allow users to rework, summarize, and customize texts, even allowing interactions with AI platforms for assistance. Furthermore, the Image Playground feature enables users to create drawings and sketches, though it does not support photorealistic graphics, while Genmoji will facilitate the generation of AI-based emojis from user-defined terms for use in messaging applications.

Another enhancement is the Smart Reply function, which provides contextual suggestions for quick responses to text messages and emails. In the Photos app, users can create "Memory Movies" by entering prompts, allowing them to compile music-backed slideshows from their photo and video libraries. The search functionality in Photos has also been improved, now accommodating natural language queries. Additionally, emails and notifications can be prioritized or aggregated based on user preferences, and an image generation tool has been introduced in Notes for drawing purposes. Apple emphasizes that the AI processes will primarily operate locally on the device, with data being transmitted to a secure, encrypted cloud computing center only when necessary.

visionOS 2.4 will also debut a new "Spatial Gallery," showcasing entertainment content, videos, photographs, and panoramic views that leverage the Vision Pro's 3D capabilities. This feature will include behind-the-scenes material from Apple TV+ productions. Moreover, a new app for iPhone will simplify the management of the Vision Pro headset, allowing for the preparation of app downloads, discovery of new content, and guidance on using the device, all while being compatible with iOS 18.4, which is also in beta testing.

Additionally, the update introduces an upgraded Guest User mode, which can be controlled via iPhone or iPad, and includes a View Mirroring option that allows hosts to monitor what guest users are doing on the headset.