Apple Previews New Accessibility Features Powered by Apple Intelligence

At a glance:

• Apple Intelligence enhances VoiceOver, Magnifier, and Voice Control with AI-driven descriptions and natural language input.
• On-device Generated Subtitles automatically transcribe audio in videos across iPhone, iPad, Mac, Apple TV, and Vision Pro, starting in English (U.S., Canada).
• Vision Pro gains Power Wheelchair Control via eye-tracking, supporting Tolt and LUCI systems in the U.S.

AI-Powered Accessibility Enhancements

Apple's latest accessibility updates leverage its on-device Apple Intelligence system to provide more intuitive and powerful tools for users with disabilities. The enhancements focus on four core areas, each integrating AI to offer richer interactions and greater independence:

• VoiceOver Image Explorer: Uses Apple Intelligence to generate detailed descriptions of images throughout the system, including photographs, scanned bills, and personal records. Users can press the Action button on iPhone to ask questions about what the camera sees, with support for natural language follow-ups.
• Magnifier: Incorporates Apple Intelligence-powered visual descriptions within its high-contrast interface for users with low vision. Accessible via the Action button, it supports spoken commands like "zoom in" or "turn on flashlight" for hands-free control.
• Voice Control: Gains natural language input, allowing users to describe onscreen elements conversationally, such as "tap the guide about best restaurants" or "tap the purple folder," rather than memorizing exact labels. Apple says this helps where on-screen elements lack proper accessibility labels.
• Accessibility Reader: Expands support for complex document layouts, including scientific articles with multiple columns, images, and tables. It adds on-demand summaries and built-in translation while retaining user preferences for fonts, colors, and formatting.

These features underscore Apple's commitment to using AI not just for productivity but for inclusive design, making technology more accessible to people with visual, auditory, motor, and cognitive challenges. The on-device processing ensures privacy while delivering real-time assistance.

New Transcription and Mobility Features

Beyond the AI-driven core features, Apple announced two additional tools aimed at improving accessibility in multimedia consumption and mobility. Generated Subtitles and Power Wheelchair Control for Apple Vision Pro represent significant strides in automatic captioning and alternative input methods:

• Generated Subtitles: Use on-device speech recognition to automatically transcribe spoken audio in uncaptioned video content across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Initially available in English in the U.S. and Canada.
• Power Wheelchair Control for Apple Vision Pro: Uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick. Launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.

Generated Subtitles address a common gap in video accessibility, especially for user-generated content or live streams without professional captioning. Power Wheelchair Control, meanwhile, opens new possibilities for immersive VR experiences for wheelchair users, leveraging Vision Pro's advanced sensors for precise, hands-free navigation.

Additional Updates and Ecosystem Integrations

Apple also detailed several smaller additions that enhance the overall accessibility ecosystem across its operating systems. These updates address motion sickness, gesture controls, hearing aid reliability, language support, text sizing, gaming, video calls, and setup personalization:

• Vehicle Motion Cues: Coming to visionOS to help reduce motion sickness when using Vision Pro as a passenger in a moving vehicle.
• Face gestures and Dwell Control: Allow performing taps and system actions, plus a new way to select elements with one's eyes.
• Made for iPhone hearing aids: Gain more reliable pairing and handoff between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.
• Name Recognition: Expands to more than 50 languages globally, notifying users who are deaf or hard of hearing if someone says their name.
• Larger Text: Coming to tvOS for viewers with low vision to increase onscreen text size.
• Sony Access controller: Gains support as a game controller on iOS, iPadOS, and macOS, with full button and thumbstick customization and support for combining two controllers.
• FaceTime API: Allows sign language interpretation app developers to add a human interpreter to ongoing video calls.
• Touch Accommodations: Gain a new way to personalize setup in iOS and iPadOS.

These incremental improvements reflect Apple's holistic approach to accessibility, ensuring that users across its device ecosystem—from iPhone to Vision Pro—benefit from consistent, thoughtful design. The FaceTime API, for instance, could transform remote communication for the deaf community by integrating professional interpreters seamlessly.

Release Timeline and Historical Context

All announced features are expected to arrive later this year alongside Apple's new operating system updates: iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27. These updates are typically unveiled at WWDC in June and ship in September. While no firm release dates are given, this annual cycle aligns with Apple's tradition of previewing accessibility features ahead of Global Accessibility Awareness Day, observed on the third Thursday of May.

Voice Control's natural language capabilities will be available in English in the U.S., Canada, the U.K., and Australia, reflecting Apple's focus on key markets. Generated Subtitles start in English for the U.S. and Canada, with potential expansion based on demand. The Power Wheelchair Control for Vision Pro is initially U.S.-only, supporting specific drive systems, indicating a phased rollout for specialized hardware integrations.

This preview strategy allows Apple to gather feedback and refine features before wide release, a process that has historically led to robust and reliable accessibility tools. The company's long-standing commitment to accessibility, dating back to early features like VoiceOver, continues to evolve with AI advancements.

Accessory Re-release: Hikawa Grip & Stand

Alongside software updates, Apple re-released the Hikawa Grip & Stand for iPhone in three new colors: Orange Swirl, Glow Blue, and Speckled Stone. Originally designed by Los Angeles-based designer Bailey Hikawa and produced by PopSockets, this adaptive MagSafe accessory was developed in collaboration with individuals with disabilities affecting grip, strength, and mobility. It is now available globally via the Apple Store online, with U.S. pricing at $54.95, following the sell-out of the initial version last year.

This accessory underscores Apple's commitment to inclusive design, extending beyond software to tangible products that address real-world needs. The partnership with PopSockets and input from the disability community highlight a user-centered approach, ensuring that physical limitations do not hinder device usage. The re-release in new colors also caters to personal expression, blending functionality with style.

Looking Ahead

Apple's accessibility announcements demonstrate how AI can be harnessed to break down barriers for people with disabilities. By integrating Apple Intelligence into core features, the company is setting a new standard for proactive, context-aware assistance. As these tools roll out, developers and users alike will watch for their real-world impact, particularly in diverse linguistic and regional contexts. The focus on on-device processing also reinforces Apple's privacy-centric ethos, a critical consideration for accessibility features that often handle sensitive data.

Future iterations may expand language support and hardware compatibility, but for now, these updates mark a significant step toward a more inclusive digital experience across Apple's platforms.