This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
nuhuh
Your AI agent said "Done." nuhuh runs the experiment
Coding agents end most tasks with "Done! All tests pass." Sometimes it's false. nuhuh is a Stop hook that extracts every claim from the agent's final message and re-runs reality, fresh tests, real exit codes, actual files, then bounces a false Done back with the evidence. Local, deterministic, no API key, MIT.
Last week my agent told me "All tests pass." One test failed. It had reported the result of a run it never made. So I built a test runner wearing a Stop hook.
nuhuh treats the final message as a list of hypotheses and re-runs each one. The whole suite in a clean process, files checked on disk, localhost actually probed. A false Done gets rejected and the evidence goes straight back to the agent, which returns to work.
It ships with a benchmark whose ground truth doesn't know the tool exists, so it catches nuhuh's own mistakes too. Across 102 runs per model, Codex falsely declared Done 2.1% of the time, Haiku 6.0%, frontier Claude 0%. And every false Done contained zero checkable claims, just confident tone, which is exactly why the benchmark exists.
That finding became a feature. NUHUH_STRICT=1 bounces any completion declaration that carries no checkable claim. Replayed against all 306 runs it catches 7 of 7 false dones, and the honest price is one extra bounce on roughly half the true dones, which is why it's opt-in and aimed at unattended lanes like CI and batch runs.
Try it without installing anything. npx nuhuh demo stages a lie and catches it in ten seconds.
Ask me anything about the false accusations we caught our own tool making, there are six and each one is now a regression test.
No comment highlights available yet. Please check back later!
About nuhuh on Product Hunt
“Your AI agent said "Done." nuhuh runs the experiment”
nuhuh was submitted on Product Hunt and earned 2 upvotes and 1 comments, placing #156 on the daily leaderboard. Coding agents end most tasks with "Done! All tests pass." Sometimes it's false. nuhuh is a Stop hook that extracts every claim from the agent's final message and re-runs reality, fresh tests, real exit codes, actual files, then bounces a false Done back with the evidence. Local, deterministic, no API key, MIT.
nuhuh was featured in Open Source (68.8k followers), Developer Tools (518.5k followers), Artificial Intelligence (477.4k followers) and GitHub (41.4k followers) on Product Hunt. Together, these topics include over 242.5k products, making this a competitive space to launch in.
Who hunted nuhuh?
nuhuh was hunted by JinHyuk Sung. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how nuhuh stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Last week my agent told me "All tests pass." One test failed. It had reported the result of a run it never made. So I built a test runner wearing a Stop hook.
nuhuh treats the final message as a list of hypotheses and re-runs each one. The whole suite in a clean process, files checked on disk, localhost actually probed. A false Done gets rejected and the evidence goes straight back to the agent, which returns to work.
It ships with a benchmark whose ground truth doesn't know the tool exists, so it catches nuhuh's own mistakes too. Across 102 runs per model, Codex falsely declared Done 2.1% of the time, Haiku 6.0%, frontier Claude 0%. And every false Done contained zero checkable claims, just confident tone, which is exactly why the benchmark exists.
That finding became a feature. NUHUH_STRICT=1 bounces any completion declaration that carries no checkable claim. Replayed against all 306 runs it catches 7 of 7 false dones, and the honest price is one extra bounce on roughly half the true dones, which is why it's opt-in and aimed at unattended lanes like CI and batch runs.
Try it without installing anything. npx nuhuh demo stages a lie and catches it in ten seconds.
Ask me anything about the false accusations we caught our own tool making, there are six and each one is now a regression test.