Open source tracing and analytics for LLM applications
Langfuse provides open-source observability and analytics for LLM apps. Observability: Explore and debug complex logs & traces in a visual UI. Analytics: Improve costs, latency and response quality using intuitive dashboards.
@mwseibel - thank you for the hunt!
Hi Product Hunt community 👋👋👋
I’m Clemens, co-founder of Langfuse. We're proud to launch our open source observability and analytics platform for LLM apps @marc_klingen @max_deichmann.
Getting to an MVP using LLMs is lightning fast. But productionizing an app and going from 80 to 100% is hard work. Langfuse is built to support makers on this journey through insights into their production data. We’ve experienced this ourselves as makers and built the product that we wanted for ourselves.
We re-think observability & analytics from the ground up for LLM applications. Langfuse can visualize & analyze even complex LLM executions such as agents, nested chains, embedding retrieval and tool usage.
📊Log traces
Integrate via SDKs (Python, JS/TS), API or 🦜🔗 Langchain to asynchronously log production traces & attach metadata
🔍Inspect & Debug
Use our visual UI to inspect & debug production traces
💯Score
Attach scores to traces through user feedback or manual scoring in our UI. Filter for high and low quality traces to improve your application quickly
🔧Dashboards
Cost: Track token counts and compute costs. Break down by user, feature, session etc. to understand your unit economics
Latency: Measure total latency and its constituents to improve UX
Quality: Monitor output quality over time, users and features to ensure your users see value
🏗Open Source
We’re open source, model-agnostic, and our fully async SDKs can integrate with any LLM.
🏃Get Started
We’re excited to hear your thoughts & feedback in the comments. To see Langfuse in action today, give our interactive demo a spin at: https://langfuse.com/docs/demoOffer: Start using Langfuse Cloud for free today and track unlimited events (up to 1GB storage) in our free tier.
You can find self-hosting instructions in our docs: https://langfuse.com/docs/deploy...