the parser processes only the first two pages of the list

wpBots Support – The best crawlers for WordPress Forums SCRAPER (after-sales) General Issues the parser processes only the first two pages of the list

Viewing 14 posts - 1 through 14 (of 14 total)
  • Author
    Posts
  • #2205
    Alex BAlex B
    Participant

    Hello!
    help me please
    I set up parsing for several pages, specify a link to the next page, however the parser processes only 2 pages and stops at that.
    How can I make the parser go through all the pages of the store?

    In the parser settings – I specified a link to the site (next)

    Attachments:
    You must be logged in to view attached files.
    #2209
    Suman M.Suman M.
    Keymaster

    Hi, thanks for contacting us. Can you please let us know your Scraper Task ID so that we can check?
    Also, make sure that your site/server’s PHP memory limit is at least 512M and Max execution time limit is 300 seconds or more.

    #2210
    Alex BAlex B
    Participant

    c1a27653191513489b4ce05c7300f658

    it works well, but first 2 pages only

    #2216
    Suman M.Suman M.
    Keymaster

    I checked it and seems to be working fine. I will need to login to your site to look into the issue further. Please let us know your site’s backend login details as private reply. And also let us know your site/server’s PHP memory limit and Max execution time limit.

    #2225
    Alex BAlex B
    Participant
    This reply has been marked as private.
    #2237
    Suman M.Suman M.
    Keymaster

    I’ve created a task “icons-store.com” in your site. Please check it and let us know. Thanks!

    #2244
    Alex BAlex B
    Participant

    According to your configuration, the parsing generally processed only one page

    #2245
    Alex BAlex B
    Participant

    only 30 url from 1 page

    Attachments:
    You must be logged in to view attached files.
    #2260
    Suman M.Suman M.
    Keymaster

    I checked the scrape preview and it’s fetching from other pages too. Can I delete all the products in draft state from your site? Better if you delete them, so that I can check the task further. Thanks!

    #2263
    Alex BAlex B
    Participant

    You can do that, everything works correctly.
    modified, which in the conductors, regret to control – which do not necessarily perform real loads.
    Participate, which cards are placed in the Tumbl, and necessarily the original.

    #2264
    Alex BAlex B
    Participant

    It seems not quite correctly translated Google

    You can do everything on the site so that the parser works correctly. Now I have deleted the drafts that he uploaded on your setup

    You can try again
    And I also draw attention to the fact that he uploads pictures to the gallery small (not originals) – can this be somehow configured?

    #2268
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    #2270
    Alex BAlex B
    Participant

    this is not scary, the error indicates the conclusion of the report, and it continues to parse with it. According to my settings – I get the first two pages – but no more. If you set up the parser parsed so that it moves on, then you can get the rest – it’s all about the parser settings.

    #2274
    Suman M.Suman M.
    Keymaster

    Scraping gallery images for each of the posts is resource heavy operation. If the gallery images are not important then you can try removing that from the scrape. Let us know.

    • This reply was modified 3 weeks, 6 days ago by Suman M.Suman M..
Viewing 14 posts - 1 through 14 (of 14 total)

You must be logged in and have valid license to reply to this topic.

License required for the following item
Login and Registration Log in · Register