This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Product upvotes vs the next 3
Waiting for data. Loading
Product comments vs the next 3
Waiting for data. Loading
Product upvote speed vs the next 3
Waiting for data. Loading
Product upvotes and comments
Waiting for data. Loading
Product vs the next 3
Loading
MockDPE: AI Built by Pilots, for Pilots
Ace your FAA pilot checkride with a realistic AI examiner
An FAA exam is the most important a pilot will ever take, costing $1000+ and going on their permanent record. MockDPE makes verbal practice possible through an AI DPE (examiner) using a custom aircraft, live weather, and real world conditions. MockDPE provides regulatory citations, grades with 96.3% consistency, and is validated by flight instructors. After each exam, you'll receive a breakdown against the FAA ACS so you know what to study. Test your IFR knowledge for free at https://mockdpe.org
Hey Product Hunt! My name is Kevin. I'm a backend engineer by trade, but also a commercial pilot.
Anyone who's gone through training for an FAA pilot certificate knows the stress of a checkride, expensive and high-stakes. You sit across from a Designated Pilot Examiner (DPE) who probes your knowledge of regulations, aircraft systems, and weather for several hours. I've seen DPEs charge anywhere from $600 to $2,500, plus a failure stays on your FAA record forever.
When I was prepping for my own checkrides, the available tools felt dated and not realistic enough to accurately replicate the exam. Everyday AI tools (and even some aviation-specific ones) don't truly understand aviation content, and the other options are totally non-immersive, such as videos and flashcards. Learning from my own training, I built MockDPE to give students a way to practice their checkride before it counts for real.
MockDPE runs full, voice-based oral exams against the official FAA Airman Certification Standards (ACS). You pick your aircraft, customize the route of flight, and upload an optional study guide or gouge. MockDPE then fetches live aviation weather, weaves real world conditions into an immersive scenario across 16,000+ US airports, and grades you task-by-task against the ACS, just as you will be when you sit across from your real DPE.
Getting a small LLM to evaluate a free-response aviation answer accurately and consistently is harder than it sounds: my initial approach of using plain RAG fell far short. Looking back at the git history, it took just under 200 iterations of prompt and system refinements to land on the current architecture.
I chose to use several smaller models, each given a narrow, rigid task so none of them get overwhelmed by too many rules or instructions. A dedicated grader model scores each user claim against injected reference cards (FAR, AIM, IFH, and other aviation content) and is forced to pull from official sources via tool calls to provide a regulatory citation of why the response is right or wrong. The result of this architecture and many training iterations is 96.3% grading consistency across runs, plus validation from instrument flight instructors.
Anyone can run a full mock checkride for free, which is enough for a few hours of focused instrument practice. At the end, you'll receive an area-by-area breakdown of exactly where you should focus your study efforts before the real exam. If you want to dive deeper, use this link for unlimited exam sessions, focused practice, and a personalized learning mode: https://mockdpe.org/r/PRODUCTHUNT
The question I keep coming back to is, at what point trusting an LLM evaluator makes sense. My answer to this was when it feels like a real evaluation, with the model having access to official resources, using mandatory regulatory citations, and earning validation from people who do this for a living. If anyone here has differing opinions, especially those who have worked with LLM evaluators, I'd love to hear your thoughts on my approach.
About MockDPE: AI Built by Pilots, for Pilots on Product Hunt
“Ace your FAA pilot checkride with a realistic AI examiner”
MockDPE: AI Built by Pilots, for Pilots was submitted on Product Hunt and earned 6 upvotes and 4 comments, placing #96 on the daily leaderboard. An FAA exam is the most important a pilot will ever take, costing $1000+ and going on their permanent record. MockDPE makes verbal practice possible through an AI DPE (examiner) using a custom aircraft, live weather, and real world conditions. MockDPE provides regulatory citations, grades with 96.3% consistency, and is validated by flight instructors. After each exam, you'll receive a breakdown against the FAA ACS so you know what to study. Test your IFR knowledge for free at https://mockdpe.org
On the analytics side, MockDPE: AI Built by Pilots, for Pilots competes within Education, Artificial Intelligence and Online Learning — topics that collectively have 555.4k followers on Product Hunt. The dashboard above tracks how MockDPE: AI Built by Pilots, for Pilots performed against the three products that launched closest to it on the same day.
Who hunted MockDPE: AI Built by Pilots, for Pilots?
MockDPE: AI Built by Pilots, for Pilots was hunted by Kevin. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of MockDPE: AI Built by Pilots, for Pilots including community comment highlights and product details, visit the product overview.
Hey Product Hunt! My name is Kevin. I'm a backend engineer by trade, but also a commercial pilot.
Anyone who's gone through training for an FAA pilot certificate knows the stress of a checkride, expensive and high-stakes. You sit across from a Designated Pilot Examiner (DPE) who probes your knowledge of regulations, aircraft systems, and weather for several hours. I've seen DPEs charge anywhere from $600 to $2,500, plus a failure stays on your FAA record forever.
When I was prepping for my own checkrides, the available tools felt dated and not realistic enough to accurately replicate the exam. Everyday AI tools (and even some aviation-specific ones) don't truly understand aviation content, and the other options are totally non-immersive, such as videos and flashcards. Learning from my own training, I built MockDPE to give students a way to practice their checkride before it counts for real.
MockDPE runs full, voice-based oral exams against the official FAA Airman Certification Standards (ACS). You pick your aircraft, customize the route of flight, and upload an optional study guide or gouge. MockDPE then fetches live aviation weather, weaves real world conditions into an immersive scenario across 16,000+ US airports, and grades you task-by-task against the ACS, just as you will be when you sit across from your real DPE.
Getting a small LLM to evaluate a free-response aviation answer accurately and consistently is harder than it sounds: my initial approach of using plain RAG fell far short. Looking back at the git history, it took just under 200 iterations of prompt and system refinements to land on the current architecture.
I chose to use several smaller models, each given a narrow, rigid task so none of them get overwhelmed by too many rules or instructions. A dedicated grader model scores each user claim against injected reference cards (FAR, AIM, IFH, and other aviation content) and is forced to pull from official sources via tool calls to provide a regulatory citation of why the response is right or wrong. The result of this architecture and many training iterations is 96.3% grading consistency across runs, plus validation from instrument flight instructors.
Anyone can run a full mock checkride for free, which is enough for a few hours of focused instrument practice. At the end, you'll receive an area-by-area breakdown of exactly where you should focus your study efforts before the real exam. If you want to dive deeper, use this link for unlimited exam sessions, focused practice, and a personalized learning mode: https://mockdpe.org/r/PRODUCTHUNT
The question I keep coming back to is, at what point trusting an LLM evaluator makes sense. My answer to this was when it feels like a real evaluation, with the model having access to official resources, using mandatory regulatory citations, and earning validation from people who do this for a living. If anyone here has differing opinions, especially those who have worked with LLM evaluators, I'd love to hear your thoughts on my approach.