This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Prompt Compass
Cut your AI bill up to 96% with a 0.57 MB prompt router
Most AI bills are simple prompts sent to expensive models. Prompt Compass is a 0.57 MB router that sends each prompt to the cheapest model that can handle it, cutting cloud AI costs up to 96% and blocks PII leaks and jailbreaks in the same ~5 ms on-device call, free. Free tier, npm SDK, VS Code/Cursor extension.
Hi Product Hunt
Here's the problem I got obsessed with: my own AI bill. Most of what every
LLM app pays frontier-model prices for is "what's the weather" in a suit
prompts a 10–30× cheaper model handles identically. Routing fixes that, but
the standard routing stack (~88 MB embedding model + vector DB) costs enough
in size and latency to eat its own savings.
So I spent months shrinking the route decision into **one 0.57 MB model** ,
smaller than a single photo that answers in **~5 ms on a plain CPU**. On
assistant-style traffic it cuts the bill **up to 96%**. And since it already
reads every prompt, the same call throws in what others sell separately: PII
blocking and jailbreak detection. The firewall is the free bonus.
What makes it different:
🪶 154× lighter than a typical embedding-based router
⚡ Decides on-device — your prompts can skip the network entirely
🌍 EN · ES · FR · DE · HI, and disguised/obfuscated text doesn't sneak past
🔒 The hosted API returns a decision and discards the prompt — never stored,
never trained on
📊 Real numbers, published with methodology: ~82% on 2,022 held-out prompts
(leakage-checked), 87.5% of real-world jailbreaks caught, <5% false blocks.
I'd rather show an honest 82 than a suspicious 99.
Free tier with no card, an npm SDK that runs fully on-device, and a VS Code /
Cursor extension.
No comment highlights available yet. Please check back later!
About Prompt Compass on Product Hunt
“Cut your AI bill up to 96% with a 0.57 MB prompt router”
Prompt Compass was submitted on Product Hunt and earned 0 upvotes and 1 comments, placing #113 on the daily leaderboard. Most AI bills are simple prompts sent to expensive models. Prompt Compass is a 0.57 MB router that sends each prompt to the cheapest model that can handle it, cutting cloud AI costs up to 96% and blocks PII leaks and jailbreaks in the same ~5 ms on-device call, free. Free tier, npm SDK, VS Code/Cursor extension.
Prompt Compass was featured in API (98.4k followers), Developer Tools (516.2k followers) and Artificial Intelligence (474.1k followers) on Product Hunt. Together, these topics include over 195.9k products, making this a competitive space to launch in.
Who hunted Prompt Compass?
Prompt Compass was hunted by Rishabh Madanpotra. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Prompt Compass stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Rishabh Madanpotra