AppGenie

AppGenie is an accessibility tool designed to make phones more usable for people with visual or motor impairments. It enables users to control their Android devices through natural voice or text commands, reducing the need for touch navigation.

AppGenie uses Android’s Accessibility Service to help users interact with supported apps and achieve their intended goals. Based on the user’s input, AppGenie performs well-defined actions — such as tapping a button, scrolling, inputing required information — to complete the requested task.

For example, a user can say: "I want to get directions to the Space Needle using Google Maps."
AppGenie will open Google Maps, search for the Space Needle, and start navigation to it. Throughout the process, AppGenie keeps the user informed by calling out its actions (e.g., “Tapping Directions”) and asks clarifying questions when needed (e.g., “How do you want to get there? Options are drive, public transport, walk, or bike.”).

AppGenie works only with a predefined set of supported apps and explicitly defined actions within those apps and doesn't take action without user input.

Who is AppGenie for?
- Blind and Low-Vision Users: Access and navigate apps more efficiently through voice or text.
- Users with Motor Impairments: Control your phone without needing complex gestures or touch precision.
- Assistive Technology Specialists: Support clients in gaining greater independence and control over their devices.