Show HN: I built an AI Agent that uses the iPhone
a year ago
- #AI
- #iOS
- #Automation
- iPhone Agent uses OpenAI models to perform tasks across multiple apps, similar to a human user.
- Built during an OpenAI hackathon, it can execute commands like taking selfies, sending messages, and opening apps.
- Features include voice and text input, accessibility tree interaction, and Always On mode with a wake word.
- Powered by GPT-4.1, it can tap, swipe, scroll, type, and open apps using Xcode's UI testing harness.
- Challenges include keyboard input improvements, handling animations, and premature task abandonment.
- Experimental software; recommends running in an isolated environment due to potential errors and data sent to OpenAI.