Start with a working TypeScript AI app with built-in inference and a multi-agent runtime. In-app agents can research, read local files, understand documents and compose specialist models. Works offline, no API keys or complicated setup for your users. Customize and ship it to desktop, web or terminal in minutes 🚀
I’m Zuhair, founder of Lloyal Labs. Today we’re launching lloyal-ai: a platform to turn open-weight models into real AI apps people can download and use.
AI developers have two choices: rent intelligence from external providers, or assemble a stack with an inference server, an orchestration framework, a vector database and Docker containers.
Assembly is the easy part. Shipping that stack as a single app users can download and expect to “just work”? Not so easy.
Then there’s the deployment question: Can the same AI application run offline on a laptop for one person, serve multiple users from an on-prem appliance like NVIDIA DGX Station, and scale to frontier GPU clusters?
In the age of API wrappers, we took the bold step of deleting the HTTP boundary between the model and the harness, bringing them into one process.
Here's what emerged from that:
1. Programming live attention state: Your TypeScript code can fork the KV cache into concurrent agents on the GPU. They inherit what the model has already read, pursue different reasoning paths, and your application governs the convergence.
2. Composition of models: Give reasoning agents resident specialists for retrieval, ranking, vision out of the box or add your own specialists for classification, recommendations and other use-cases. Compose them as services in ordinary TypeScript or expose expert models as tools for the reasoning model.
3. Tools that participate in live inference: Tools in lloyal have superpowers: they access agent state, spawn sub-agents and respond to what the cohort has already done. Their results feed directly into the same live context.
And the form factor question: The same app runs offline on your laptop under Desktop target, can be served to multiple users and scale to frontier hardware under Web target.
local models as downloadable apps is a usefull angle 👏 who's it mainly for, indie devs?
@zuhairnaqvi@kazim_musa_ll The no api key part is pretty interesting. Congrats on the launch! curious to see where you take this
Kazim here, the other maker. The best way to see what Zuhair's describing is to scaffold an app and keep the dev pane open while it works:
npx lloyal-ai new
Pick a template (we recommend research) and keep the desktop surface ticked. Then:
cd your-app-name
npm run dev:desktop
First launch fetches and verifies three weights: a 4B reasoning model, a 0.6B reranker and a vision projector. Then ask it something worth investigating. You'll see the planner write an outline, a shared spine fork off it, and research agents inherit that spine and search at the same time. One model, inside your app's process, no API key.
Everything it generated is your TypeScript to change: the interface, the prompts, the tools, how the agents work. When you're happy, npx lloyal-ai ship --notarize builds a signed Mac installer (bring your Apple credentials).
If you try it, tell us where it got stuck. And what would you build on it?
About Lloyal on Product Hunt
“Turn open-weight models into AI apps people can download”
Lloyal launched on Product Hunt on October 2nd, 2026 and earned 109 upvotes and 6 comments, placing #14 on the daily leaderboard. Start with a working TypeScript AI app with built-in inference and a multi-agent runtime. In-app agents can research, read local files, understand documents and compose specialist models. Works offline, no API keys or complicated setup for your users. Customize and ship it to desktop, web or terminal in minutes 🚀
Lloyal was featured in Software Engineering (43.2k followers), Privacy (11.4k followers) and Artificial Intelligence (481.6k followers) on Product Hunt. Together, these topics include over 149.4k products, making this a competitive space to launch in.
Who hunted Lloyal?
Lloyal was hunted by Zuhair Naqvi. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Lloyal stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Zuhair Naqvi
Hello Product Hunters!
I’m Zuhair, founder of Lloyal Labs. Today we’re launching lloyal-ai: a platform to turn open-weight models into real AI apps people can download and use.
AI developers have two choices: rent intelligence from external providers, or assemble a stack with an inference server, an orchestration framework, a vector database and Docker containers.
Assembly is the easy part. Shipping that stack as a single app users can download and expect to “just work”? Not so easy.
Then there’s the deployment question: Can the same AI application run offline on a laptop for one person, serve multiple users from an on-prem appliance like NVIDIA DGX Station, and scale to frontier GPU clusters?
In the age of API wrappers, we took the bold step of deleting the HTTP boundary between the model and the harness, bringing them into one process.
Here's what emerged from that:
1. Programming live attention state: Your TypeScript code can fork the KV cache into concurrent agents on the GPU. They inherit what the model has already read, pursue different reasoning paths, and your application governs the convergence.
2. Composition of models: Give reasoning agents resident specialists for retrieval, ranking, vision out of the box or add your own specialists for classification, recommendations and other use-cases. Compose them as services in ordinary TypeScript or expose expert models as tools for the reasoning model.
3. Tools that participate in live inference: Tools in lloyal have superpowers: they access agent state, spawn sub-agents and respond to what the cohort has already done. Their results feed directly into the same live context.
And the form factor question: The same app runs offline on your laptop under Desktop target, can be served to multiple users and scale to frontier hardware under Web target.
Under the hood: Shared agent context along with liblloyal's Continous Tree Batching algorithm (https://github.com/lloyal-ai/lib...) means concurrent agents are paid for in space rather than compute (RunPod's CEO Zhen Lu posted about this: https://www.linkedin.com/posts/z...)
Get started:
npx lloyal-ai new
No API key. No Docker, Ollama, LangGraph, Mastra or vector database required.
Just your code and the model - what will you build?