Cloudflare "You've been blocked"
-
Yesterday I managed to scrape a lot of data and everything worked fine but today I am seeing a lot of "You've been blocked" pages from cloudflare. I tried many different things like changing fingerprints and the time my bot spends on the site but it makes no difference. I am suspecting that my proxies got banned?
Anyone have any idea about this error and if it is a IP ban, is it a permanent ban?
My workflow:
If profile exists Switch profile (Yes fingerprint + No proxy) Else Apply fingerprint. 15 days with perfect canvas Apply proxy Load URL Sleep Click Login Button //You've been blocked Sleep Enter email + password wait Scrape
-
i think the problem is with proxy. and try to make sleep on every action
-
@black_mamba I have tried sleeping twice as long as when it was working ok but it didn't make a difference. if it is my proxies than only half seem to be affected.
Stranger yet, when I take the affected proxy and I use it manually in firefox, it works fine