An open-source implementation of Anthropic's Computer Use to perform basic tasks using AI Agents. Currently supports Langchain, Azure OpenAI Models, and Gemini models. Contributions and supports are more than welcomed to improve the functionality.
Hi PHers 👋🏻,
Anthropic has taken the world by storm with their latest Computer Use model. It can perform arbitrary actions on the system using text prompts. This is one big feat in AI Development 🤯
❓ Why Clevrr Computer?
With Recent development in such models, it got me thinking if other models would be capable of doing the same or not? Clevrr Computer is a Langchain ReAct Agent with multi-modal modals like Google's Gemini 1.5 Pro and OpenAI's GPT-4o to perform actions on the system computer like mouse movements, web search, native app controls, etc. The possibilities are endless with such a technology and this is just the beginning.
💻 What can you do with it?
You can use Clevrr Computer to reply to your Mom on WhatsApp, spin up a fun conversation with ChatGPT on the web with 2 AIs, or do research and analysis on basic web search.
⚙️ How it works?
It's a multi-modal AI Agent running at the back with a constant screenshot capturing mechanism to learn what it is seeing on the screen and direct the main action agent to function accordingly, using python to perform actions automagically.
⛔ Does it have limitations?
Of course, it does (and it should, honestly) have limitation in terms of the screen access, code complexity, some tasks performance, etc.
🧪 Where can I try it?
Check out the full steps to download and use the Agent within your computer at https://github.com/Clevrr-AI/Cle...
I would love for you to contribute to make this project perfect and fast forward the era of AI agents! Contributions are more than welcome. 💖
About Clevrr Computer on Product Hunt
“Computer use but with OpenAI and Gemini models”
Clevrr Computer launched on Product Hunt on October 25th, 2024 and earned 205 upvotes and 12 comments, placing #7 on the daily leaderboard. An open-source implementation of Anthropic's Computer Use to perform basic tasks using AI Agents. Currently supports Langchain, Azure OpenAI Models, and Gemini models. Contributions and supports are more than welcomed to improve the functionality.
On the analytics side, Clevrr Computer competes within Open Source, Artificial Intelligence, GitHub and Tech — topics that collectively have 1.2M followers on Product Hunt. The dashboard above tracks how Clevrr Computer performed against the three products that launched closest to it on the same day.
Who hunted Clevrr Computer?
Clevrr Computer was hunted by Yuvraj Dagur. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Clevrr Computer including community comment highlights and product details, visit the product overview.
Yuvraj Dagur