Warehouse every AI request to your database. Query logs to analyze usage and costs, evaluate models, and generate datasets. Install the proxy with 2 lines of code. It’s free to get started, and you own your data.
Hey Product Hunt 👋 Emma and Chris here from Velvet. We built an AI gateway to warehouse OpenAI and Anthropic requests to your database. Engineers use Velvet logs to analyze usage and costs, evaluate models, and generate datasets.
Our first product was an AI SQL editor. It worked really well, but we had limited insights into what happened between our app and OpenAI. We started storing requests to our database, giving us the ability to query data directly. It gave us so much more control over developing our AI features.
We didn’t think of it as a product until one of our customers (Find AI) asked to use it. We warehoused over 3 million requests for them in the first week, logging up to 1,500 requests per second during their launch. Now we have many startups using Velvet daily for caching, evaluations, and analysis of opaque endpoints like the Batch API.
It's easy to get started! Once set up, we warehouse every request to your database.
Requests are formatted as JSON. You can include custom metadata in the header - like user ID, org ID, model ID, and version ID. This means you can run complex SQL queries unique to your app. Granularly calculate costs, evaluate new models, or identify datasets for fine-tuning.
We'd love to hear from you! Email [email protected] with any feedback or questions.
