This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Profile
Physics grounded, & cost aware, optimization loop for vLLM
Profile computes the physics ceiling for your GPU and model, measures the live server against it, names the one cause holding it back, and gives you the flag to change.
Hi Product Hunt,
Profile's engineer here!
Most GPUs serving LLMs deliver a fraction of what the hardware can do, and the gap hides behind a handful of server flags. Finding the right flags is usually days of trial and error.
Profile replaces the guessing. It computes the fastest your GPU can physically serve your model, watches your live server, and names the one thing slowing it down, with the exact flag to change. You apply it, Profile measures the difference.
On my RTX 5090 that loop took a 30B model from 81 to 421 tokens/s in 4 iterations, about 30 minutes. Cost per million tokens fell 81%. On an H100 running Qwen: 1.9x, cost down 48%. Both runs are on video, including the step that made things worse; Profile labeled it "worse" and the next fix recovered it. A tool that only reports wins can't be trusted when it reports one.
Free, open source (Apache 2.0), works with vLLM today, more engines next. Ask me anything, and tell me what it finds on your serve
No comment highlights available yet. Please check back later!
About Profile on Product Hunt
“Physics grounded, & cost aware, optimization loop for vLLM”
Profile was submitted on Product Hunt and earned 2 upvotes and 1 comments, placing #158 on the daily leaderboard. Profile computes the physics ceiling for your GPU and model, measures the live server against it, names the one cause holding it back, and gives you the flag to change.
Profile was featured in Open Source (68.8k followers), Developer Tools (518.5k followers) and GitHub (41.4k followers) on Product Hunt. Together, these topics include over 124.8k products, making this a competitive space to launch in.
Who hunted Profile?
Profile was hunted by Gagandeep Singh . A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Profile stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Gagandeep Singh