Pi

The ML & Data Science toolkit; built for Software Engineers.

Developer Tools

Artificial Intelligence

👋 Hi Product Hunt makers! I’m David, co-founder at Pi Labs. Our goal is to put the most advanced ML and data science techniques and algorithms in the hands of all software engineers, so that you can build AI applications at the same level of performance and sophistication as the big labs. We’re excited to announce our first product launch and keen to get feedback from the maker community. Pi can very quickly: 🔢 Build your scoring system to reliably measure your AI’s response quality. 💬 Auto optimize your prompt by running DSPy algorithms against your scoring system 🧾 Generate cheap high quality synthetic data based on seed input to train your model 📈 Compile high quality reward models to run RL algorithms like PPO and GRPO 🔄 Build your feedback loop by finetuning your scoring model with your user data 🔎 Rewrite your queries and customize your Ranking for your RAG backend … and more! What’s special about Pi’s technology? ** Pi is inspired by the MVC architecture for Web. Scorers on one side of the loop, Optimizers on the other side of it. You update your scorers, they auto-update your optimizers, keeping your loop in sync. All optimizers "compile" against the same scoring system. This means you just interface with scoring, letting Pi handle the algorithmic heavy lifting. ** Pi’s scoring models are small and fast encoder models trained specifically for scoring. They let you assess 20+ quality dimensions in sub 100ms. This means you can use them beyond just evaluation; from reward modeling for RL to online control flow with agents. ** Pi’s scoring models can be calibrated with human feedback. Manual calibration, labeled data, or preference pairs, your scoring system adjusts to your and your users’ preference creating robust feedback loops for your application. ** Pi’s playgrounds allow you to easily interact with even complex workflows like synthetic data generation or routing. When you’re done vibe checking any particular technique or algorithm, you can deploy in code to scale. Try Pi out, no sign in required at https://build.withpi.ai. Have Pi build your first scoring system in less than 2 minutes and start optimizing your AI right away. You can also visit https://code.withpi.ai for our API reference and links to end to end tutorials and notebooks that show you how to use those techniques in real-world examples. Excited to hear your feedback!