For more than a decade, Apple has been developing Apple Vision Pro, their augmented and virtual reality headset. It marks Apple's first venture into a new product category since the Apple Watch in 2015. The device was introduced at WWDC 2023 in June and is scheduled for launch in early 2024.
Although Apple Vision Pro is a headset, it is actually called a spatial computer by Apple. This is due to its unique capability of seamlessly merging digital content with the real world.
Apple Vision Pro is a mixed-reality headset that presents a combination of augmented reality content, overlaying digital elements onto the real world, and immersive virtual content. However, it's important to highlight that the headset does not have a see-through display. Instead, everything you see is digitally rendered. To enable augmented reality experiences without obstructing your surroundings, Apple incorporates cameras that capture and translate the real-world view into a digital image, enhancing it with virtual elements.
Apple deactivates the cameras to provide a virtual reality encounter, creating a sense of complete isolation from the surrounding environment. This enables users to concentrate exclusively on the content displayed on the screens of the headset. The transition between the "real" and the "immersive" experiences can be managed effortlessly using an on-device Digital Crown.
In terms of design, the Apple Vision Pro shares similarities with ski goggles, featuring a single piece of laminated glass for the front that seamlessly integrates into an aluminium alloy frame. The frame also includes a soft and custom-fit Light Seal, which attaches magnetically and conforms to your face, effectively blocking out external light sources.
The Apple Vision Pro has two Audio Straps with built-in speakers positioned on the sides of the headset. These speakers provide Spatial Audio, blending the sounds from the headset with the real-world environment. The headset is held in place by a comfortable and adjustable 3D knitted headband. It is designed to be breathable, cushiony, and stretchy for a snug fit. Apple offers Light Seals and headbands in different sizes that can be easily interchanged.
The Apple Vision Pro does not rely on controllers; instead, it offers control through eye tracking, hand gestures, and voice commands. Navigating and selecting apps can be done by looking at them and tapping the fingers for opening. Scrolling is as simple as flicking the fingers.
To provide a comprehensive user experience, Apple Vision Pro is equipped with a number of cameras and sensors that map the surrounding environment and track hand and eye movements. The Optic ID feature utilizes infrared lights and cameras to scan your iris for authentication. Similar to Face ID and Touch ID, each person has a unique iris pattern, allowing Optic ID to be used for device unlocking, purchases, and password replacement.
Inside the Vision Pro, you'll find two Apple silicon chips—one of which is the M2 chip, also found in Macs and a new R1 chip. The M2 chip powers the visionOS, executes computer vision algorithms, and handles graphics, while the R1 chip processes input from cameras, sensors, and microphones.
Capture memorable moments with the built-in camera of the Apple Vision Pro, activated by tapping the top button of the device. Apple promises the ability to capture 3D photos and videos, offering an immersive way to relive those memories. The headset also showcases existing photos and videos on a larger scale, enhancing the immersive experience. During video recording, an animation on the external display indicates that the recording is in progress.
To address weight problems, Apple decided not to include a built-in battery in the Apple Vision Pro. Instead, it can be powered through a braided cable connected to a battery pack worn at the hip or plugged into an adapter. With a single charge, the battery pack provides approximately two hours of usage.
The Apple Vision Pro presents content displayed in the space around you. You have the flexibility to position apps and windows in mid-air, rearranging them according to your preference. Multiple windows are supported, and Apple emphasizes the availability of an "infinite canvas" to work with. Apps can be displayed within your actual environment, allowing you to stay engaged with your surroundings. Alternatively, you can opt for a more immersive view, where the content is presented on a virtual background known as an Environment, blocking out the external world.
Apple Vision Pro operates on the visionOS operating system and has its own dedicated App Store that offers a selection of apps tailored specifically for the device. Additionally, it is capable of running iPhone and iPad apps. The headset can be connected to a Mac, serving as an external display. Bluetooth accessories can be used for text input and control, or virtual typing and dictation can be employed for text input.
The main Home View on Apple Vision Pro resembles the familiar iPhone interface and includes favourite Apple apps like Mail, Messages, Music, Safari, Photos, and more. Data is synced through iCloud, ensuring seamless accessibility. Apple has updated its main apps for visionOS and provided APIs for developers, encouraging the creation of new experiences. The Apple Vision Pro offers an immersive entertainment experience, enabling content to expand and create a personalized theatre-like environment, accompanied by spatial audio.
For Vision Pro, FaceTime has undergone a redesign to enhance the user experience. During FaceTime calls, participants appear in large tiles to the wearer of the headset, while the wearer themselves is represented as an accurate digital recreation using their Digital persona. With FaceTime on Vision Pro, users can collaborate on documents, share apps, and benefit from spatial audio, which helps identify the speaker.
The Cinema Environment offers an immersive viewing experience, allowing you to watch shows and movies at the frame rate and aspect ratio chosen by the content creator. Alternatively, you can select a nature-themed environment that creates a sense of a 100-foot-wide screen. Apple has created Apple Immersive Videos, which are 180-degree 3D recordings with an 8K resolution, placing users right in the heart of the action. Additionally, popular streaming services like Apple TV+ and Disney+ are accessible on Vision Pro. As for gaming, Vision Pro supports Apple Arcade, with a launch lineup of 100 iPad games. Bluetooth game controllers can be used to play games on the headset.
The starting price for Apple Vision Pro is $3,499, and its anticipated launch is scheduled for early 2024. Upon its release, the headset will be available for purchase on Apple.com. Initially, it will be exclusively available in stores within the United States.