Reworkd is your scraping co-pilot. Reworkd understands website structures and auto-generates Playwright code to take actions, visit subpages, scrape, and save data based on your custom schema. It's time to do data different.
We’re super excited today to announce that we're launching Reworkd: your AI scraping co-pilot.
Our company journey first started with AgentGPT which hit 1M users and 30k GitHub stars in just a few months. From there we went through YC and spent many, many months talking to users and iterating in the LLM agent space. Many micro pivots later, we eventually discovered that many companies were struggling with the same problem: managing the engineering burden of building and maintaining scrapers across hundreds of sites.
So we build the platform specifically for companies that need to regularly scrape the same 10s if not 100s of websites to power their products.
Here are some of the things that make us different:
Our platform automatically generates Playwright code to extract website data into your custom schema.
You have full autonomy over this code: you can provide additional guidance in chat and even update the code in our built-in IDE
We handle all of the proxy and antibot measures for you.
You can schedule scrapers to run at your desired frequency, choose between full or incremental scraping, and deduplicate data based on a primary key.
Easily ingested all of your scraped data via an API
We've been working with power users who scrape 100s of sites, and they've helped us refine the platform over the past year. Use cases we're seeing include:
E-commerce product data for AI shopping solutions or price monitoring
Government sites for bids, rules, and regulations
Company career pages for job postings
Real estate listings from brokers and MLS systems
If you're scraping 10+ sites regularly, we’d love your feedback—try our platform and let us know what you think. Product Hunters: enjoy 50% off your first month!
Looking forward to your thoughts on how we can make this better 🫡
