This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Lucy Screen Agent
A screen-aware AI agent that operates Android by voice
Lucy is an experimental open-source Android agent that sees the current screen, reads the accessibility tree, and taps, types, or swipes to complete voice commands—across apps, without integrations. Built with Flutter, Kotlin, and Gemini.
Hey Product Hunt! 👋
I'm Mohamad Ghaith Alzin, the maer of Lucy.
Most voice assistants can only act insid apps someone has integrated. Lucy explores a differnt model: use the phone the way a person does.
You seak a task. Lucy captures the screen, reads Android' accessibility tree, asks Gemini for one next action then taps, types, swipes, or navigates. After everyaction, it re-observes the UI and continues until th task is complete.
I started Lucy after thinking abot all the moments when tapping a phone is difficult r inconvenient—limited dexterity, cooking, workshops carrying a child, or simply navigating a long settigs flow. The result is an open-source research projet that can operate across Android apps without app-secific APIs.
Today's release includes:
• Voice inputand spoken replies
• Screenshot + accessibility-treereasoning
• Element-ID taps instead of guessed coordnates
• English, Japanese, and Arabic
• A persistentStop Lucy notification and a 50-step limit
• A bringyour-own Gemini API key
• No Lucy backend, account, nalytics, or telemetry
An important caveat: Lucy isexperimental and needs powerful screen-capture and acessibility permissions. Screenshots and visible UI ext are sent to Google's Gemini API during active taks. Please read the repository's Privacy & Security ection and use a spare or test device.
I'm especialy looking for:
• Feedback from different Android devces and apps
• Contributors for confirmation gates, pp allowlists/blocklists, pluggable AI backends, mor languages, and better testing
• Introductions to acessibility, open-source, or responsible-AI grants an sponsors
Lucy is free, MIT-licensed, and built wit Flutter + Kotlin.
What would be the first Android ask you'd ask Lucy to handle? 🔮
No comment highlights available yet. Please check back later!
About Lucy Screen Agent on Product Hunt
“A screen-aware AI agent that operates Android by voice”
Lucy Screen Agent was submitted on Product Hunt and earned 0 upvotes and 1 comments, placing #146 on the daily leaderboard. Lucy is an experimental open-source Android agent that sees the current screen, reads the accessibility tree, and taps, types, or swipes to complete voice commands—across apps, without integrations. Built with Flutter, Kotlin, and Gemini.
Lucy Screen Agent was featured in Android (57.5k followers), Open Source (68.8k followers), Artificial Intelligence (477.8k followers) and GitHub (41.4k followers) on Product Hunt. Together, these topics include over 208.9k products, making this a competitive space to launch in.
Who hunted Lucy Screen Agent?
Lucy Screen Agent was hunted by Mohamad Ghaith Alzin. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Lucy Screen Agent stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Mohamad Ghaith Alzin