This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Product upvotes vs the next 3
Waiting for data. Loading
Product comments vs the next 3
Waiting for data. Loading
Product upvote speed vs the next 3
Waiting for data. Loading
Product upvotes and comments
Waiting for data. Loading
Product vs the next 3
Loading
Developer Farm
AI coding pipeline that can't cheat the tests
When AI agents see your test suite and acceptance criteria, they don't solve the problem β they solve the tests. Developer Farm is an open-source AI coding pipeline that makes metric gaming physically impossible through strict 4-layer isolation: π Planning never sees execution results π Execution never sees the test suite or rubric π Verification doesn't know who wrote the code π Retry feedback never leaks the scoring criteria Built on LangGraph + local Ollama + Qwen models
Hey Product Hunt! π
I'm Ilya, a software engineer who got tired of AI coding tools that technically pass tests but miss the point.
Six months ago I was debugging a "working" feature built by an AI agent. The tests were green. The code was clean. But it solved a slightly different problem than what I asked for.
That's when Goodhart's Law clicked: when you give an agent the test suite, it optimizes for the test suite β not the problem.
So I built Developer Farm as a side project. The core idea is simple: split the pipeline into isolated layers where each layer is physically prevented from seeing information it shouldn't. The executor never sees the tests. The verifier doesn't know who wrote the code. Feedback never leaks the rubric.
I expected this to be a weekend hack. Turns out it's a genuinely useful way to build software:
β’ $0.03 per feature (runs on my old GTX 1050 Ti)
β’ 26 seconds end-to-end
β’ Real git branches per attempt
β’ Full audit trail of every decision
Open-sourced it under MIT because I think the industry needs more honest AI tools, not just smarter ones.
Would love your feedback:
- What isolation patterns have you found useful in AI workflows?
- What features would make this production-ready for your team?
- Anyone else fighting Goodhart's Law in their AI systems?
Happy to answer anything in the comments!
About Developer Farm on Product Hunt
βAI coding pipeline that can't cheat the testsβ
Developer Farm was submitted on Product Hunt and earned 0 upvotes and 1 comments, placing #100 on the daily leaderboard. When AI agents see your test suite and acceptance criteria, they don't solve the problem β they solve the tests. Developer Farm is an open-source AI coding pipeline that makes metric gaming physically impossible through strict 4-layer isolation: π Planning never sees execution results π Execution never sees the test suite or rubric π Verification doesn't know who wrote the code π Retry feedback never leaks the scoring criteria Built on LangGraph + local Ollama + Qwen models
On the analytics side, Developer Farm competes within Open Source, Developer Tools, Artificial Intelligence and GitHub β topics that collectively have 1.1M followers on Product Hunt. The dashboard above tracks how Developer Farm performed against the three products that launched closest to it on the same day.
Who hunted Developer Farm?
Developer Farm was hunted by Illya Rochev. A βhunterβ on Product Hunt is the community member who submits a product to the platform β uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Developer Farm including community comment highlights and product details, visit the product overview.
Illya Rochev