This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
When AI agents see your test suite and acceptance criteria, they don't solve the problem β they solve the tests. Developer Farm is an open-source AI coding pipeline that makes metric gaming physically impossible through strict 4-layer isolation: π Planning never sees execution results π Execution never sees the test suite or rubric π Verification doesn't know who wrote the code π Retry feedback never leaks the scoring criteria Built on LangGraph + local Ollama + Qwen models
Hey Product Hunt! π
I'm Ilya, a software engineer who got tired of AI coding tools that technically pass tests but miss the point.
Six months ago I was debugging a "working" feature built by an AI agent. The tests were green. The code was clean. But it solved a slightly different problem than what I asked for.
That's when Goodhart's Law clicked: when you give an agent the test suite, it optimizes for the test suite β not the problem.
So I built Developer Farm as a side project. The core idea is simple: split the pipeline into isolated layers where each layer is physically prevented from seeing information it shouldn't. The executor never sees the tests. The verifier doesn't know who wrote the code. Feedback never leaks the rubric.
I expected this to be a weekend hack. Turns out it's a genuinely useful way to build software:
β’ $0.03 per feature (runs on my old GTX 1050 Ti)
β’ 26 seconds end-to-end
β’ Real git branches per attempt
β’ Full audit trail of every decision
Open-sourced it under MIT because I think the industry needs more honest AI tools, not just smarter ones.
Would love your feedback:
- What isolation patterns have you found useful in AI workflows?
- What features would make this production-ready for your team?
- Anyone else fighting Goodhart's Law in their AI systems?
Happy to answer anything in the comments!
No comment highlights available yet. Please check back later!
About Developer Farm on Product Hunt
βAI coding pipeline that can't cheat the testsβ
Developer Farm was submitted on Product Hunt and earned 0 upvotes and 1 comments, placing #100 on the daily leaderboard. When AI agents see your test suite and acceptance criteria, they don't solve the problem β they solve the tests. Developer Farm is an open-source AI coding pipeline that makes metric gaming physically impossible through strict 4-layer isolation: π Planning never sees execution results π Execution never sees the test suite or rubric π Verification doesn't know who wrote the code π Retry feedback never leaks the scoring criteria Built on LangGraph + local Ollama + Qwen models
Developer Farm was featured in Open Source (68.5k followers), Developer Tools (514k followers), Artificial Intelligence (471k followers) and GitHub (41.3k followers) on Product Hunt. Together, these topics include over 207.8k products, making this a competitive space to launch in.
Who hunted Developer Farm?
Developer Farm was hunted by Illya Rochev. A βhunterβ on Product Hunt is the community member who submits a product to the platform β uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Developer Farm stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Illya Rochev