Turn open-weight models into AI apps people can download
Start with a working TypeScript AI app with built-in inference and a multi-agent runtime. In-app agents can research, read local files, understand documents and compose specialist models. Works offline, no API keys or complicated setup for your users. Customize and ship it to desktop, web or terminal in minutes 🚀
I’m Zuhair, founder of Lloyal Labs. Today we’re launching lloyal-ai: a platform to turn open-weight models into real AI apps people can download and use.
AI developers have two choices: rent intelligence from external providers, or assemble a stack with an inference server, an orchestration framework, a vector database and Docker containers.
Assembly is the easy part. Shipping that stack as a single app users can download and expect to “just work”? Not so easy.
Then there’s the deployment question: Can the same AI application run offline on a laptop for one person, serve multiple users from an on-prem appliance like NVIDIA DGX Station, and scale to frontier GPU clusters?
In the age of API wrappers, we took the bold step of deleting the HTTP boundary between the model and the harness, bringing them into one process.
Here's what emerged from that:
1. Programming live attention state: Your TypeScript code can fork the KV cache into concurrent agents on the GPU. They inherit what the model has already read, pursue different reasoning paths, and your application governs the convergence.
2. Composition of models: Give reasoning agents resident specialists for retrieval, ranking, vision out of the box or add your own specialists for classification, recommendations and other use-cases. Compose them as services in ordinary TypeScript or expose expert models as tools for the reasoning model.
3. Tools that participate in live inference: Tools in lloyal have superpowers: they access agent state, spawn sub-agents and respond to what the cohort has already done. Their results feed directly into the same live context.
And the form factor question: The same app runs offline on your laptop under Desktop target, can be served to multiple users and scale to frontier hardware under Web target.
No API key. No Docker, Ollama, LangGraph, Mastra or vector database required.
Just your code and the model - what will you build?
About Lloyal on Product Hunt
“Turn open-weight models into AI apps people can download”
Lloyal launched on Product Hunt on October 2nd, 2026 and earned 109 upvotes and 6 comments, placing #14 on the daily leaderboard. Start with a working TypeScript AI app with built-in inference and a multi-agent runtime. In-app agents can research, read local files, understand documents and compose specialist models. Works offline, no API keys or complicated setup for your users. Customize and ship it to desktop, web or terminal in minutes 🚀
On the analytics side, Lloyal competes within Software Engineering, Privacy and Artificial Intelligence — topics that collectively have 536.2k followers on Product Hunt. The dashboard above tracks how Lloyal performed against the three products that launched closest to it on the same day.
Who hunted Lloyal?
Lloyal was hunted by Zuhair Naqvi. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Lloyal including community comment highlights and product details, visit the product overview.
Zuhair Naqvi
Hello Product Hunters!
I’m Zuhair, founder of Lloyal Labs. Today we’re launching lloyal-ai: a platform to turn open-weight models into real AI apps people can download and use.
AI developers have two choices: rent intelligence from external providers, or assemble a stack with an inference server, an orchestration framework, a vector database and Docker containers.
Assembly is the easy part. Shipping that stack as a single app users can download and expect to “just work”? Not so easy.
Then there’s the deployment question: Can the same AI application run offline on a laptop for one person, serve multiple users from an on-prem appliance like NVIDIA DGX Station, and scale to frontier GPU clusters?
In the age of API wrappers, we took the bold step of deleting the HTTP boundary between the model and the harness, bringing them into one process.
Here's what emerged from that:
1. Programming live attention state: Your TypeScript code can fork the KV cache into concurrent agents on the GPU. They inherit what the model has already read, pursue different reasoning paths, and your application governs the convergence.
2. Composition of models: Give reasoning agents resident specialists for retrieval, ranking, vision out of the box or add your own specialists for classification, recommendations and other use-cases. Compose them as services in ordinary TypeScript or expose expert models as tools for the reasoning model.
3. Tools that participate in live inference: Tools in lloyal have superpowers: they access agent state, spawn sub-agents and respond to what the cohort has already done. Their results feed directly into the same live context.
And the form factor question: The same app runs offline on your laptop under Desktop target, can be served to multiple users and scale to frontier hardware under Web target.
Under the hood: Shared agent context along with liblloyal's Continous Tree Batching algorithm (https://github.com/lloyal-ai/lib...) means concurrent agents are paid for in space rather than compute (RunPod's CEO Zhen Lu posted about this: https://www.linkedin.com/posts/z...)
Get started:
npx lloyal-ai new
No API key. No Docker, Ollama, LangGraph, Mastra or vector database required.
Just your code and the model - what will you build?