Mac LLM server that cuts agent wait times from 90s to 5s
oMLX turns your Mac into a full LLM inference server, run from the menu bar. It serves text, vision, OCR, embedding and reranker models with continuous batching, plus a RAM+SSD tiered KV cache that survives restarts, so Claude Code and Cursor respond in about 5s instead of 90s. OpenAI and Anthropic compatible APIs drop straight in. Native Swift, not Electron. Apache 2.0, open source.
Kept hitting the same wall with local models: the agent loops back, the whole conversation recomputes, 90 seconds of nothing.
oMLX writes the KV cache to SSD. Old context comes back in milliseconds, even after a restart. Claude Code on a local model stops feeling like dial-up.
Jun has been shipping this almost daily since February. 21k stars, and his Show HN still barely got seen. Felt wrong.
If you run models on a Mac: what does your stack look like? Curious what people pair this with.
About oMLX on Product Hunt
“Mac LLM server that cuts agent wait times from 90s to 5s”
oMLX launched on Product Hunt on August 30th, 2026 and earned 88 upvotes and 17 comments, placing #13 on the daily leaderboard. oMLX turns your Mac into a full LLM inference server, run from the menu bar. It serves text, vision, OCR, embedding and reranker models with continuous batching, plus a RAM+SSD tiered KV cache that survives restarts, so Claude Code and Cursor respond in about 5s instead of 90s. OpenAI and Anthropic compatible APIs drop straight in. Native Swift, not Electron. Apache 2.0, open source.
On the analytics side, oMLX competes within Open Source, Developer Tools, Artificial Intelligence and GitHub — topics that collectively have 1.1M followers on Product Hunt. The dashboard above tracks how oMLX performed against the three products that launched closest to it on the same day.
Who hunted oMLX?
oMLX was hunted by Rabnoor Singh. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of oMLX including community comment highlights and product details, visit the product overview.
Rabnoor Singh