Pi is a toolkit of 30+ AI techniques designed to boost the quality of your AI apps. Pi first builds your scoring system to capture your application requirements and then compiles 30+ optimizers against it - automated prompt opt., search ranking, RL & more.
👋 Hi Product Hunt makers! I’m David, co-founder at Pi Labs. Our goal is to put the most advanced ML and data science techniques and algorithms in the hands of all software engineers, so that you can build AI applications at the same level of performance and sophistication as the big labs. We’re excited to announce our first product launch and keen to get feedback from the maker community.
Pi can very quickly:
🔢 Build your scoring system to reliably measure your AI’s response quality.
💬 Auto optimize your prompt by running DSPy algorithms against your scoring system
🧾 Generate cheap high quality synthetic data based on seed input to train your model
📈 Compile high quality reward models to run RL algorithms like PPO and GRPO
🔄 Build your feedback loop by finetuning your scoring model with your user data
🔎 Rewrite your queries and customize your Ranking for your RAG backend
… and more!
What’s special about Pi’s technology?
** Pi is inspired by the MVC architecture for Web. Scorers on one side of the loop, Optimizers on the other side of it. You update your scorers, they auto-update your optimizers, keeping your loop in sync. All optimizers "compile" against the same scoring system. This means you just interface with scoring, letting Pi handle the algorithmic heavy lifting.
** Pi’s scoring models are small and fast encoder models trained specifically for scoring. They let you assess 20+ quality dimensions in sub 100ms. This means you can use them beyond just evaluation; from reward modeling for RL to online control flow with agents.
** Pi’s scoring models can be calibrated with human feedback. Manual calibration, labeled data, or preference pairs, your scoring system adjusts to your and your users’ preference creating robust feedback loops for your application.
** Pi’s playgrounds allow you to easily interact with even complex workflows like synthetic data generation or routing. When you’re done vibe checking any particular technique or algorithm, you can deploy in code to scale.
Try Pi out, no sign in required at https://build.withpi.ai. Have Pi build your first scoring system in less than 2 minutes and start optimizing your AI right away. You can also visit https://code.withpi.ai for our API reference and links to end to end tutorials and notebooks that show you how to use those techniques in real-world examples.
Excited to hear your feedback!
@david_karam well played, launching on March 14th.
SaaS founder here. How does Pi handle real-time feedback loops for continuous improvement? Can it adapt scoring models based on user interactions over time?
This is really cool. I see so many uses. As soon as I will have a bit of time I will see how to integrate the scoring and comparison and such into my app using the node client and let it grow the data and then I will be able to improve on things.
Do you happen to have an idea about how much will this cost? I see things just work and you are paying for the AI in the playground for now, but obviously that is not sustainable :)
I met @david_karam last summer the AI Engineer’s World Fair. At the time we chatted, I was stuck trying to optimize a prompt pipeline that just wouldn’t do what I wanted to do, and I was patching around it in the only kind of way I could with my software engineering toolkit – with iterative refinement, rules-based approaches and decomposition.
Of course it wasn’t going to work. I had ML-envy, and was eyeing all the fancy RL and finetuning that the ML engineers around me understood, and I didn’t know where to start with. I knew I needed the power of the tools they were experts at, but I couldn’t afford a month away from product development to go off and to find out how to build a scoring model.
And then David told me they were building that! High-level primitives and workflows for software engineers to have the power of ML expertise in their team. I can just download an API token and immediately have the primitives I need to focus on the product.
I’m super excited to start building with Pi. I love a leveraged tool that lets me focus on the product. The roadmap of things that are coming up looks awesome. Congratulations to the team on launching something truly useful right out the gate.
This tool sounds amazing for making complex systems easier to manage! How does Pi ensure the models stay efficient and scalable when working with large datasets, and are there any specific projects you've found it especially helpful for?
Nice work launching on Pi Day! Forgive the naive question, but how does this stack up with RAG and other approaches people are using to improve models right now?
