Product upvotes vs the next 3

Waiting for data. Loading

Product comments vs the next 3

Waiting for data. Loading

Product upvote speed vs the next 3

Waiting for data. Loading

Product upvotes and comments

Waiting for data. Loading

Product vs the next 3

Loading

Reworkd

Scrape 100s of unique websites using AI

Reworkd is your scraping co-pilot. Reworkd understands website structures and auto-generates Playwright code to take actions, visit subpages, scrape, and save data based on your custom schema. It's time to do data different.

Top comment

Hey Product Hunt! 👋


We’re super excited today to announce that we're launching Reworkd: your AI scraping co-pilot.


Our company journey first started with AgentGPT which hit 1M users and 30k GitHub stars in just a few months. From there we went through YC and spent many, many months talking to users and iterating in the LLM agent space. Many micro pivots later, we eventually discovered that many companies were struggling with the same problem: managing the engineering burden of building and maintaining scrapers across hundreds of sites.


So we build the platform specifically for companies that need to regularly scrape the same 10s if not 100s of websites to power their products.


Here are some of the things that make us different:

  1. Our platform automatically generates Playwright code to extract website data into your custom schema.

  2. You have full autonomy over this code: you can provide additional guidance in chat and even update the code in our built-in IDE

  3. We handle all of the proxy and antibot measures for you.

  4. You can schedule scrapers to run at your desired frequency, choose between full or incremental scraping, and deduplicate data based on a primary key.

  5. Easily ingested all of your scraped data via an API

We've been working with power users who scrape 100s of sites, and they've helped us refine the platform over the past year. Use cases we're seeing include:

  • E-commerce product data for AI shopping solutions or price monitoring

  • Government sites for bids, rules, and regulations

  • Company career pages for job postings

  • Real estate listings from brokers and MLS systems

If you're scraping 10+ sites regularly, we’d love your feedback—try our platform and let us know what you think. Product Hunters: enjoy 50% off your first month!


Looking forward to your thoughts on how we can make this better 🫡