This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
LightCrawl
Lightweight, self-hostable Web scraping API & MCP server
LightCrawl is an ultra-fast, lightweight, and self-hostable web scraping API and Model Context Protocol (MCP) server optimized for LLMs. Features: • Built with TypeScript and Playwright for reliable scraping. • Seamless Brave Search integration for autonomous browsing. • Formats messy web pages into clean, LLM-ready Markdown. • 100% open-source and easy to self-host with Docker & Railway. Turn any website into clean data for your AI agents in seconds!
Hi Product Hunt community! 👋
I'm the creator of LightCrawl. As an engineering manager working deeply with infrastructure, I built LightCrawl because I needed a simpler, faster way to feed clean web data into AI agents without relying on heavy, expensive SaaS scraping platforms.
LightCrawl is a lightweight, 100% open-source alternative built with TypeScript and Playwright. It converts messy web pages into perfectly formatted, LLM-ready Markdown in seconds and includes full Model Context Protocol (MCP) server support right out of the box, making it seamless to connect with tools like Cursor or Claude Code.
It's designed to be completely stateless, self-hostable, and secure. You can spin it up instantly via Docker or deploy it to Railway with a single click.
I'd love to hear your thoughts, feedback, or feature requests!
Self-hostable scraping API that also works as an MCP server is a really smart combo. AI agents need fresh web data constantly and the last thing you want is hitting rate limits from a third-party service mid-workflow. The Playwright-based rendering is a good call too - most of the interesting data is behind dynamic pages these days. Curious about the memory footprint when running headful Playwright at scale - how does it hold up on a modest VPS?
Do you support caching so agents don’t keep rescraping the same pages and burning time?
About LightCrawl on Product Hunt
“Lightweight, self-hostable Web scraping API & MCP server”
LightCrawl was submitted on Product Hunt and earned 8 upvotes and 4 comments, placing #27 on the daily leaderboard. LightCrawl is an ultra-fast, lightweight, and self-hostable web scraping API and Model Context Protocol (MCP) server optimized for LLMs. Features: • Built with TypeScript and Playwright for reliable scraping. • Seamless Brave Search integration for autonomous browsing. • Formats messy web pages into clean, LLM-ready Markdown. • 100% open-source and easy to self-host with Docker & Railway. Turn any website into clean data for your AI agents in seconds!
LightCrawl was featured in Open Source (68.6k followers), Developer Tools (515.4k followers), Artificial Intelligence (473.1k followers) and GitHub (41.3k followers) on Product Hunt. Together, these topics include over 217.9k products, making this a competitive space to launch in.
Who hunted LightCrawl?
LightCrawl was hunted by Suzuki Yosuke. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how LightCrawl stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Suzuki Yosuke