This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Product upvotes vs the next 3
Waiting for data. Loading
Product comments vs the next 3
Waiting for data. Loading
Product upvote speed vs the next 3
Waiting for data. Loading
Product upvotes and comments
Waiting for data. Loading
Product vs the next 3
Loading
Reame
Self-hosted LLM inference on the hardware you already have
Reame is a CPU-first LLM inference server on llama.cpp with an OpenAI-compatible API. Built for narrow, repetitive workloads on cheap hardware — a €5 VPS, a free tier, a 2-core ARM box. Its memory layer caches prompts, prefixes and past generations to disk, so request #100 costs a fraction of request #1. MIT.
I kept hitting the same wall: I had narrow, repetitive AI work — extracting fields from documents, classifying tickets, tagging products in batches — and every option pushed me toward a metered API or a GPU I didn't want to rent. But these workloads don't need frontier reasoning. The answer lives in the context you already provide. That's exactly where a small model on a cheap CPU is enough — if the server stops treating every request as brand new.
So Reame is built on one rule: on a CPU, never compute the same thing twice.
A persistent shared-prefix KV cache — prompt prefixes are snapshotted to disk and reused across different prompts, restarts and processes. A system prompt is paid for once, by the first user.
Palimpsest — every generation feeds an on-disk archive that drafts future tokens for free. Domain workloads repeat; let them pay off.
Self-regulating speculation — it measures whether speculation pays on your hardware and turns itself off when it doesn't.
ARCA — a Redis-compatible shared-memory daemon so a fleet shares an exact cache and a generation corpus. One config line wires a node to it.
An OpenAI-compatible API — point any OpenAI client at it. reame run qwen2.5-1.5b --serve and you have an endpoint.
What it is not: a ChatGPT replacement. Frontier reasoning and broad knowledge need frontier parameter counts. Reame is for the narrow, repetitive, private-data cases — and it says so.
Everything is measured on real hardware, including the results that hurt: a 30B-class MoE that answered perfectly and 10× too slow; oversubscribed vCPUs where speculation backfires (so Reame disables it); consensus voting that fixes variance but not a model's actual reasoning gap. Benchmarks that only show wins are advertising — these aren't.
MIT-licensed, C++17, 254 isolated tests, CI on Linux + macOS, prebuilt binaries
Homebrew. Repo: https://github.com/swellweb/reame
I'd love to hear: what repetitive LLM workload are you running (or would run) on cheap hardware, and what's stopping you today? I answer everything here.
About Reame on Product Hunt
“Self-hosted LLM inference on the hardware you already have”
Reame was submitted on Product Hunt and earned 9 upvotes and 5 comments, placing #141 on the daily leaderboard. Reame is a CPU-first LLM inference server on llama.cpp with an OpenAI-compatible API. Built for narrow, repetitive workloads on cheap hardware — a €5 VPS, a free tier, a 2-core ARM box. Its memory layer caches prompts, prefixes and past generations to disk, so request #100 costs a fraction of request #1. MIT.
On the analytics side, Reame competes within Open Source, Developer Tools, Artificial Intelligence and GitHub — topics that collectively have 1.1M followers on Product Hunt. The dashboard above tracks how Reame performed against the three products that launched closest to it on the same day.
Who hunted Reame?
Reame was hunted by Marco Caciotti. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Reame including community comment highlights and product details, visit the product overview.
Marco Caciotti