wpBots Support

Helpdesk for Best Scraper Plugin

Search in:
Suggested Search: installation, demo data, icons

the parser processes only the first two pages of the list

wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › General Issues › the parser processes only the first two pages of the list

Viewing 15 posts - 1 through 15 (of 18 total)
1 2
  • Author
    Posts
  • June 2, 2020 at 3:32 pm #2205
    Alex BAlex B
    Participant

    Hello!
    help me please
    I set up parsing for several pages, specify a link to the next page, however the parser processes only 2 pages and stops at that.
    How can I make the parser go through all the pages of the store?

    In the parser settings – I specified a link to the site (next)

    Attachments:
    You must be logged in to view attached files.
    June 3, 2020 at 3:22 am #2209
    Suman M.Suman M.
    Keymaster

    Hi, thanks for contacting us. Can you please let us know your Scraper Task ID so that we can check?
    Also, make sure that your site/server’s PHP memory limit is at least 512M and Max execution time limit is 300 seconds or more.

    June 3, 2020 at 10:12 am #2210
    Alex BAlex B
    Participant

    c1a27653191513489b4ce05c7300f658

    it works well, but first 2 pages only

    June 4, 2020 at 4:08 am #2216
    Suman M.Suman M.
    Keymaster

    I checked it and seems to be working fine. I will need to login to your site to look into the issue further. Please let us know your site’s backend login details as private reply. And also let us know your site/server’s PHP memory limit and Max execution time limit.

    June 4, 2020 at 3:41 pm #2225
    Alex BAlex B
    Participant
    This reply has been marked as private.
    June 5, 2020 at 4:32 pm #2237
    Suman M.Suman M.
    Keymaster

    I’ve created a task “icons-store.com” in your site. Please check it and let us know. Thanks!

    June 6, 2020 at 3:02 pm #2244
    Alex BAlex B
    Participant

    According to your configuration, the parsing generally processed only one page

    June 6, 2020 at 3:05 pm #2245
    Alex BAlex B
    Participant

    only 30 url from 1 page

    Attachments:
    You must be logged in to view attached files.
    June 9, 2020 at 6:59 am #2260
    Suman M.Suman M.
    Keymaster

    I checked the scrape preview and it’s fetching from other pages too. Can I delete all the products in draft state from your site? Better if you delete them, so that I can check the task further. Thanks!

    June 9, 2020 at 11:44 pm #2263
    Alex BAlex B
    Participant

    You can do that, everything works correctly.
    modified, which in the conductors, regret to control – which do not necessarily perform real loads.
    Participate, which cards are placed in the Tumbl, and necessarily the original.

    June 10, 2020 at 11:44 am #2264
    Alex BAlex B
    Participant

    It seems not quite correctly translated Google

    You can do everything on the site so that the parser works correctly. Now I have deleted the drafts that he uploaded on your setup

    You can try again
    And I also draw attention to the fact that he uploads pictures to the gallery small (not originals) – can this be somehow configured?

    June 12, 2020 at 8:13 pm #2268
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    June 12, 2020 at 9:38 pm #2270
    Alex BAlex B
    Participant

    this is not scary, the error indicates the conclusion of the report, and it continues to parse with it. According to my settings – I get the first two pages – but no more. If you set up the parser parsed so that it moves on, then you can get the rest – it’s all about the parser settings.

    June 15, 2020 at 6:57 am #2274
    Suman M.Suman M.
    Keymaster

    Scraping gallery images for each of the posts is resource heavy operation. If the gallery images are not important then you can try removing that from the scrape. Let us know.

    • This reply was modified 4 years, 6 months ago by Suman M.Suman M..
    July 22, 2020 at 7:54 pm #2403
    Alex BAlex B
    Participant

    Can you configure the parser to work?!? It doesn’t work correctly!

  • Author
    Posts
Viewing 15 posts - 1 through 15 (of 18 total)
1 2

You must be logged in and have valid license to reply to this topic.

License required for the following item
Scraper - Automatic Content Crawler Plugin for WordPress
Login and Registration Log in · Register