This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Traditional evals test outputs, missing when agents loop on tools or burn 50% more tokens. AgentDiff fixes this by recording agent runs as DAGs and diffing execution trajectories against golden baselines directly in CI. It catches tool loops, cost spikes, and latency regressions before merge evaluating how the model arrived at the answer, not just what it returned. Framework-agnostic with adapters for OpenAI Agents, Langfuse, LangSmith, and OpenInference.
The annoying bug that started this: I refactored an agent, all tests passed, and it silently started calling the DB tool in a loop. Cost went up ~50% and only the invoice caught it.
The part I'm most proud of is that it posts the report onto the PR automatically. There's a real example in the repo - a Gemini agent that looped get_user_database_stats twice, AgentDiff flagged the culprit step, and the job failed the gate. No manual diffing, no reading raw traces.
No comment highlights available yet. Please check back later!
About AgentDiff on Product Hunt
“Trajectory regression testing for AI agents”
AgentDiff was submitted on Product Hunt and earned 4 upvotes and 1 comments, placing #65 on the daily leaderboard. Traditional evals test outputs, missing when agents loop on tools or burn 50% more tokens. AgentDiff fixes this by recording agent runs as DAGs and diffing execution trajectories against golden baselines directly in CI. It catches tool loops, cost spikes, and latency regressions before merge evaluating how the model arrived at the answer, not just what it returned. Framework-agnostic with adapters for OpenAI Agents, Langfuse, LangSmith, and OpenInference.
AgentDiff was featured in Open Source (68.8k followers), Software Engineering (42.9k followers), Artificial Intelligence (477.4k followers) and GitHub (41.4k followers) on Product Hunt. Together, these topics include over 168.3k products, making this a competitive space to launch in.
Who hunted AgentDiff?
AgentDiff was hunted by Sahil. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how AgentDiff stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Sahil