wpBots Support

Helpdesk for Best Scraper Plugin

Search in:
Suggested Search: installation, demo data, icons

bypass cloudflare 5 seconds delay?

wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (pre-sales) › General enquiry › bypass cloudflare 5 seconds delay?

Viewing 6 posts - 1 through 6 (of 6 total)
  • Author
    Posts
  • March 24, 2020 at 11:57 pm #1713
    Sss IiiiSEDDIK IGUIJJI
    Participant

    is it possible bypass cloudflare 5 seconds delay?

    March 25, 2020 at 6:39 am #1718
    Suman M.Suman M.
    Keymaster

    Hi, it cannot be achieved with Scraper plugin. Can you please explain why and where do you need this?

    March 25, 2020 at 7:15 am #1719
    Sss IiiiSEDDIK IGUIJJI
    Participant

    it is the under attack mode from cloudflare they give delay of 5 seconds then redirect to site this is an example
    https://www.anime-planet.com/anime/watch-online/dubbed/
    there are some script on github that help with this like when using curl
    maybe you can implement it ?

    March 25, 2020 at 12:38 pm #1720
    Suman M.Suman M.
    Keymaster

    Okay got it, but currently Scraper cannot bypass it. We have added it in our ToDo list, but it’ll take time for this to be implemented. Thanks!

    March 25, 2020 at 7:04 pm #1728
    Sss IiiiSEDDIK IGUIJJI
    Participant

    ok just keep in mind cloudflare always implements changes to bypass so better implement a library that is periodically updated also features to be considered
    simulate button click : sometimes content is locked behind a submit button to show content
    make multilevel scraping for example serial scraping is you load a page with post you click and element then save content sometimes that is not the case sometimes it requires 2 clicks
    if these were implemented maan that would be sooooo goood

    March 26, 2020 at 5:36 am #1730
    Suman M.Suman M.
    Keymaster

    Noted! Thanks for your valuable input.

  • Author
    Posts
Viewing 6 posts - 1 through 6 (of 6 total)
  • You must be logged in to reply to this topic.