An open high-performance model gateway for your GenAI apps
- Unified Chat API - Low-latency resilient routing & fallback across 4 strategies: the least latency, round-robin, weighted round-robin, priority-based - Model-specific Prompting - and much more ✨
Glide has officially reached the Private Preview maturity 🎉🎉🎉
As a part of this initial scope, we had to setup a bunch of common things to make it roll. As for the core functionality, we have brought up:
- The routing functionality with four types of routing strategies (including a tricky one like the least latency routing)
- The first-class adaptive resiliency & fallbacking across all routing strategies
- Unified Chat API that supports popular model providers like OpenAI, Azure OpenAI (on-prem models), Cohere, OctoML, Anthropic
- The ability to have model-specific prompts
- Installation via Docker & Homebrew
The most exciting things are ahead of us, so looking forward to get more cool stuff in scope of Public Preview 🚀
Let's equip GenAI revolution with a resilient open infrastructure :raised_hands:
📦 Release: https://github.com/EinStack/glid...
📚 Docs: https://glide.einstack.ai/
📺 Demo: https://github.com/EinStack/glid...
🗺️ Roadmap: https://github.com/EinStack/glid...
About Glide on Product Hunt
“An open high-performance model gateway for your GenAI apps”
Glide launched on Product Hunt on February 2nd, 2024 and earned 107 upvotes and 19 comments, placing #13 on the daily leaderboard. - Unified Chat API - Low-latency resilient routing & fallback across 4 strategies: the least latency, round-robin, weighted round-robin, priority-based - Model-specific Prompting - and much more ✨
On the analytics side, Glide competes within Developer Tools, Artificial Intelligence and GitHub — topics that collectively have 1M followers on Product Hunt. The dashboard above tracks how Glide performed against the three products that launched closest to it on the same day.
Who hunted Glide?
Glide was hunted by Roman Glushko. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Glide including community comment highlights and product details, visit the product overview.
Roman Glushko