Apple announces new accessibility features including Eye Tracking and Music Haptics

Apple has announced a range of new accessibility features to be launched with forthcoming software updates including iOS 18, iPadOS 18, macOS 15, and visionOS 2. Key features include Eye Tracking for iPhone and iPad, enabling users with physical disabilities to navigate system interfaces and apps using their eyes, similar to how the Vision Pro works. The technology, powered by AI, uses the front-facing camera for setup and calibration, requiring no additional hardware or accessories, and securely stores all data on the device.

Another new feature is the Music Haptics, which enhances the music experience for users who are deaf or hard of hearing by using the iPhone's Taptic Engine to play synchronized taps, textures, and vibrations with the music's audio. Vocal Shortcuts is also being introduced, allowing users to assign custom utterances to Siri for simplified voice command execution. The Vehicle Motion Cues feature aims to reduce motion sickness through the use of animated dots on the screen's edges to represent changes in vehicle motion. Additional updates include enhanced features for Apple CarPlay such as Voice Control, Color Filters, and Sound Recognition, which alerts those who are deaf or hard of hearing to car horns and sirens.

visionOS 2 will support Live Captions, enabling users to follow spoken dialogue in various audio sources, along with other systemwide enhancements like Reduce Transparency, Smart Invert, and Dim Flashing Lights. Mac users, on the other hand, will be able to personalize VoiceOver keyboard shortcuts, and macOS 15 will introduce Mandarin support for Personal Voice. You can learn about all the additional features in the official announcement.