Site-specific scrapers for the data leg of BAS flows

Moved Private Software
  • I use BAS for the glue, but the per-site scraping is where I lose hours to captcha. I keep a collection called 2scraper, 66 site-specific scrapers where the challenge flow is handled per site. It is MIT, and it runs on Playwright, Selenium or Puppeteer under the hood.

    For BAS users I think the fit is simple. Pull the data from a 2scraper repo, which outputs JSON/CSV, and let BAS do the posting and uploading. That probably saves the visual-editor rebuild for a site that fights reCAPTCHA.

    https://github.com/2scraper

    Not trying to replace BAS, just flagging that the scraping leg is often already done.

  • ModeratorM Moderator moved this topic from Share your BAS applications