At Web Summit Lisbon 2024, Sarah Herrlinger—Apple’s global head of accessibility—spoke passionately about how AI is transforming the way people with disabilities interact with Apple devices and how Apple is committed to this mission.
In today’s fast-paced technological landscape, accessibility has emerged as a vital aspect of product design. The innovations brought forth by Apple not only demonstrate their commitment to inclusivity but also set a benchmark in the tech industry. Herrlinger’s insights highlighted a transformative journey that has evolved over decades, emphasizing the importance of user-centric design in technology.
🌟 Accessibility Is Part of Apple’s DNA and Philosophy
Apple’s accessibility journey began back in 1985. Herrlinger emphasized that the company considers accessibility “a human right”—a philosophy that has driven innovation across their products, showcasing Apple’s dedication to inclusivity.
This commitment is evident in various Apple products, which cater to a broad spectrum of disabilities. For instance, the introduction of VoiceOver on the iPhone allowed visually impaired users to interact with their devices in an unprecedented way, showcasing how technology can empower rather than limit.
👁️ AI-Powered Eye Tracking & AssistiveTouch
New AI features include:
These AI advancements not only enhance user experience but also promote independence among individuals with disabilities. The integration of technology into everyday tasks provides users with tools that were previously unavailable. For example, users can now manage their daily schedules or participate in video calls with ease, thanks to these inclusive features.
-
Eye Tracking for iPhone and iPad, letting users navigate menus and tap controls just with their gaze.
-
AssistiveTouch on Apple Watch, where gestures like the “Double Tap” let users interact without touching the screen.
AssistiveTouch extends its benefits beyond traditional use cases. Users can customize their gestures, making it easier to access applications or controls that are often used. This level of personalization ensures that individuals can tailor their devices to fit their unique needs, promoting a sense of ownership and autonomy.
These tools not only help users with motor challenges—they also enhance hands-free convenience across the board.
🔊 Sound Recognition & Voice Control
Apple also leverages AI to support users with hearing or speech impairments:
Moreover, these solutions are not isolated; they work in tandem with existing features, creating a seamless experience. For instance, users can combine Sound Recognition with notifications on their devices, ensuring they never miss important alerts, regardless of their hearing capabilities. This multi-faceted approach exemplifies Apple’s dedication to comprehensive accessibility.
-
Sound Recognition alerts users to important noises (like doorbells or alarms).
-
Vocal Shortcuts and Personal Voice help users create custom voice commands or replicate their voice—using only a few phrases.
Customizing voice commands through Vocal Shortcuts brings a personal touch to technology. Users can create specific commands tailored to their everyday tasks, streamlining their interaction with technology. This is particularly beneficial for individuals who may have difficulty enunciating standard commands.
🆕 New Features: Magnifier, Braille, Captions & More
Apple’s recent updates pack even more accessible surprises:
In addition to these features, the Magnifier for Mac has gained attention for its unique functionality. Users can utilize their iPhones as a camera to enhance their reading experience, demonstrating how Apple integrates its ecosystem to provide powerful assistive technology.
-
Magnifier for Mac (with live views via iPhone camera), ideal for reading small text or presentation slides.
-
Braille Access across Apple devices, supporting note-taking and math using Nemeth Braille—and even real-time captioning on braille displays.
The inclusion of Braille Access across devices is a game-changer for the visually impaired community. Not only does it support traditional Braille, but it also enables complex tasks such as math, thus extending educational opportunities for users who rely on this system.
-
Live Captions system-wide and in visionOS, empowering users who are hard of hearing to follow app and FaceTime audio in real-time.
-
App Store Accessibility Nutrition Labels, which clearly list supported features like VoiceOver, large fonts, and captions—helping users make informed app choices.
Furthermore, the App Store Accessibility Nutrition Labels empower users to make informed choices based on their accessibility needs. This transparency allows users to quickly identify which apps will work best for them, enhancing their overall experience and fostering a sense of community among users.
💬 Why It Matters
Herrlinger highlighted how embedding AI in accessibility not only empowers individuals—it also “democratizes” access. These features are built into every device at no extra cost, replacing the need for expensive assistive tools.
In a world where accessibility is often an afterthought, Apple’s proactive approach serves as an inspiration for other tech companies. By prioritizing accessibility at the design stage, they are paving the way for a future where all users, regardless of ability, can fully engage with technology.
By integrating AI early in product design, Apple aims to reduce stigma and spark widespread innovation across all user experiences .
✨ Final Thoughts
Apple continues reshaping what inclusive tech looks like, using AI to introduce thoughtful tools that extend beyond traditional needs. By taking a holistic, built-in approach, they’re helping users not just adapt—but thrive.
Ultimately, Apple’s commitment to accessibility signifies a broader shift in the tech landscape. It is a clarion call to all companies to recognize the importance of creating inclusive products that cater to diverse needs. As Apple continues to innovate, it is clear that the future of technology will be built on the principles of accessibility and inclusivity, ensuring that no one is left behind.
