Product Thumbnail

Featherless AI

Run every 🦙 AI model & more from 🤗 huggingface

API
Artificial Intelligence
Tech

Featherless is a platform to use the very latest open source AI models from Hugging Face. With hundreds of new models daily, you need dedicated tools to keep with the hype. No matter your use-case, find and use the state of the art AI model with Featherless.

Top comment

Hello Product Hunters! 🪶 I'm super excited to launch Featherless.AI today! A platform that allows quick access to all the top 🦙 models you see in Hugging Face 🤗 today. From the 8B to the merged 11B's and Qwen-2 72B's I know it's daunting for folks to download and set up all these large models on GPUs to try them, one at a time. Also renting GPUs can be incredibly expensive as it's typically several dollars per hour. On the flip side, popular providers may not have the various finetune, or even weird model sizes that you would love to try. That's why we built featherless AI. To eventually download and provide access to **all** of hugging face public models. Making all the various open-source AI models more accessible. Starting with a simple $10 or $25 monthly plan, with unlimited usage (within the concurrency limit). So anyone can use it personally, across any model, without worrying about token pricing in their day-to-day usage. Also: as the team who also helps build open-source foundation models (hey RWKV folks!), we fully understand the concerns various folks have over data security and privacy. As such, featherless.ai has no logging of any of your message prompts and completion. Why? Because we are not interested in stealing your data to train our models. So use it any way you want to, dun let someone else tell you how you should use your AI models. 🪄 The magic behind it? At the heart of it, is a custom-built inference infrastructure, built by the team here from Recursal.AI : which was built to be able to dynamically hot-swap models in sub-seconds. Allowing us to rapidly autoscale and dynamically adjust our infrastructure based on what models are popular. Once we have the models downloaded into our cluster. This allows us to provide more models, where previous providers have been limited in ensuring every model hosted has a dedicated GPU for it. 💬 In summary 🏃‍♂️ Run any of over 450+ huggingface models 🛠️ OpenAI compatible API, use your existing tools or client 📈 Unlimited usage (within concurrent usage) 🦙 Starting at $10/month for <15B models 🦅 To $25/month for 72B models 🎁 Special for PH: Signup with a subscription, and add referral `[email protected]` for $10 off your next month bill Feel free to ask me anything here on the product hunt launch! And give it a try with a free trial, which allows you to chat with the models (up to a limited amount of messages) at https://featherless.ai

Comment highlights

Congrats on the launch! How do you ensure model performance and response times across different model sizes?

Congrats on launching Featherless AI! It’s incredible to see a platform that simplifies access to the latest AI models from Hugging Face.

Hey Team Featherless.AI, Congratulations on the launch of Featherless.AI! 🎉 This is a game-changer for anyone looking to access top models on Hugging Face without the hassle and high costs of setting up and renting GPUs. By offering a wide range of models with simple and affordable pricing plans, you’re making cutting-edge AI technology accessible to everyone. The focus on data security and privacy is commendable, and the custom-built infrastructure to dynamically hot-swap models is truly innovative. This ensures users can explore a vast array of models seamlessly. Excited to see how Featherless.AI transforms the AI landscape!

How does Featherless ensure the integration of these models remains user-friendly? It sounds like an amazing platform! The ability to access the latest open-source AI models from Hugging Face is also fantastic.

How does featherless tie into the novel models that you developed with recursal? Is it similar to OpenRouter? What are some of the top reasons to switch over to Featherless vs using other API's?

That's crazy that you offer this for $10-20; read about how you are swapping out models in almost real time, that's super cool! Thank you for making open source AI world a better place. As someone without the knowledge on how to deploy LLMs, this is a cool way to test out all kinds of OSAI quickly! Congrats @eugene_cheah !

Platform is very quick and fluid. Good UI, I think this has great potential. Update the main site with api pricing info, thanks!

Congratulations on launching Featherless AI on Product Hunt! As a user, I'd love to see more tutorials or use case examples to maximize the platform's potential.

Great product, very useful to be able to use and change llama models instantly, without having to set up and deploy a server myself!!

I was a big fan of hugging face's first product, which truly brought a revolution to the AI community. AT the same time, it's really awesome to Featherless to have it improved it with even more advanced capabilities.

Congrats on the launch! Featherless AI offers great access to Hugging Face models at a fair price Excited to see what it can do!

Amazing launch! Featherless.AI makes using top models so much easier and cheaper. Can't wait to test it out.

Inoticed your pricing details did not mention anything about API access. Perhaps you could update it so non PH users can see it too :) Congrats on the launch!