NobodyWho is an inference engine for running LLMs fully on-device, built on llama.cpp. Open-source, free, no API keys, no cloud calls. We support Swift, Kotlin, Flutter, React Native, Python, and Godot. Includes type-safe tool calling with automatic grammar generation, multimodal input, Text-to-Speech & Speech-to-Text, GPU acceleration via Vulkan & Metal, and Hugging Face model downloads.
We've spent the last months getting local inference to be production-ready across six platforms and frameworks, not just a cool demo that works on one device.
With NobodyWho you can: - Get answers from any open-weight AI models: Gemma, Qwen, LFM... - Analyse images and audio through multimodal input - Transcribe speech to text with any Whisper models - Generate natural-sounding speech with Supertonic, Pocket TTS and Kokoro models - Tool calling with guaranteed schema-valid output, the grammar is built from your function signature so the model can't return malformed JSON - Run long conversations without hitting a hard message-length wall, thanks to preemptive context shifting
Local inference on-device sounds obvious but almost never ships clean. I keep hitting setups where the demo works, then you wait twelve minutes for the model to load and the novelty dies. What does first inference look like on a mid-range Mac with something like Qwen 1.5B? Trying to figure out if this is ready for daily use or still more of a weekend experiment.
niceeee, Godot support is unusual. is the intended use NPCs that stay local or tools that game clients aren’t supposed to phone home?
Running AI models fully on device is becoming more important than ever. Love the focus on privacy, offline capability, and broad platform support instead of relying on cloud APIs. Great launch!
Six platforms including Godot is a wild spread - most on-device inference projects stop at one and call it a day.
We went the other way on a consumer app I'm building: on-device only for the narrow stuff (Apple Vision for photo classification, SFSpeechRecognizer for voice, both tiny and purpose-built) and kept anything needing real context on the server. The deciding factor wasn't output quality - it was that the AI features need months of user history in the context window, and on a phone that's either impossible or unbearably slow.
So the honest question: at what tokens/sec and what context length does local actually replace a cloud call for you? Not for a demo - for a feature someone hits ten times a day without thinking about it. That's the number I keep failing to find in these projects.
And half-joking, half-not: if this takes off, the memory story gets interesting fast. We'll end up with phones shipping 32–64GB of RAM because a photo app wants a 12B-35B model resident. :)
About NobodyWho on Product Hunt
“Run AI models on any device”
NobodyWho launched on Product Hunt on August 20th, 2026 and earned 106 upvotes and 19 comments, placing #15 on the daily leaderboard. NobodyWho is an inference engine for running LLMs fully on-device, built on llama.cpp. Open-source, free, no API keys, no cloud calls. We support Swift, Kotlin, Flutter, React Native, Python, and Godot. Includes type-safe tool calling with automatic grammar generation, multimodal input, Text-to-Speech & Speech-to-Text, GPU acceleration via Vulkan & Metal, and Hugging Face model downloads.
NobodyWho was featured in Android (57.5k followers), Open Source (68.8k followers), Developer Tools (518.3k followers) and Artificial Intelligence (477.2k followers) on Product Hunt. Together, these topics include over 259.3k products, making this a competitive space to launch in.
Who hunted NobodyWho?
NobodyWho was hunted by Pierre. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how NobodyWho stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Pierre
Hey, I'm Pierre from NobodyWho 👋
We've spent the last months getting local inference to be production-ready across six platforms and frameworks, not just a cool demo that works on one device.
With NobodyWho you can:
- Get answers from any open-weight AI models: Gemma, Qwen, LFM...
- Analyse images and audio through multimodal input
- Transcribe speech to text with any Whisper models
- Generate natural-sounding speech with Supertonic, Pocket TTS and Kokoro models
- Tool calling with guaranteed schema-valid output, the grammar is built from your function signature so the model can't return malformed JSON
- Run long conversations without hitting a hard message-length wall, thanks to preemptive context shifting
Wanna try our work on your device? We've built a few demo apps: iOS, Android, Apple Watch & Vision Pro.
We've also built starter examples to get started in 5 minutes and a model selection page.
NobodyWho inference engine is open-source & free, please leave a star to support us on Github 👈
Happy to answer any questions :)