wpBots Support

Helpdesk for Best Scraper Plugin

Search in:
Suggested Search: installation, demo data, icons

Multiple post not working

wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › Tasks Troubleshooting › Multiple post not working

Tagged: 

Viewing 15 posts - 1 through 15 (of 26 total)
1 2
  • Author
    Posts
  • March 23, 2020 at 10:38 am #1665
    abrar akhtarabrar akhtar
    Participant

    Hi,

    I am trying to scrape this site clutch.co. When I click on Single Post then the page loads up and I am able to scrape a single post. If I click Multiple Post then the page disappears then it says: ‘Please select serial item link or enter content link first! Go to Feed section, select pick tool for serial item on sidebar, select your feed post’s link.’

    I have attached the screen shots below.

    Please let me know what the issue is.

    Cheers,

    Abrar

    Attachments:
    You must be logged in to view attached files.
    March 23, 2020 at 11:34 am #1670
    Suman M.Suman M.
    Keymaster

    Hi, thanks for contacting us. Can you please let us know what serial items you want to scrape from clutch.co so that we can help you with creating the scraper task?

    March 23, 2020 at 11:56 am #1672
    abrar akhtarabrar akhtar
    Participant

    Hi, I want to scrape all the names of the companies listed there:
    – the names of the company plus
    – the one liner of the company
    – the tags related to the company such as verified, revenue along the right side of the entry.

    thanks,

    Abrar

    March 24, 2020 at 6:57 am #1710
    Suman M.Suman M.
    Keymaster

    Okay got it. In that case you’ll need to scrape from pages like https://clutch.co/web-developers
    I checked it and could scrape from it – https://www.screencast.com/t/iHLBIMfQkJxd

    Please follow this tutorial – https://support.wpbots.net/documentation/create-a-task-on-scraper/
    Let us know if any issue.

    March 29, 2020 at 1:36 pm #1740
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    Yes if you see from my previous screenshot that is the URL that I am trying to scrape from but I am getting the same message. If you don’t mind could you record a quick video of yourself going through the steps on clutch.co/web-developers from step 1?

    Thanks,

    Abrar

    March 30, 2020 at 11:29 am #1743
    Suman M.Suman M.
    Keymaster

    Hi, please let us know your site’s wp-admin login details (as private reply) so that we can create a scraper task for you. Thanks!

    March 30, 2020 at 1:54 pm #1744
    abrar akhtarabrar akhtar
    Participant
    This reply has been marked as private.
    March 31, 2020 at 6:42 am #1747
    Suman M.Suman M.
    Keymaster

    Hi, I’ve created a task “clutch.co_web-developers” in your site. Please check and let us know if any issue.

    April 1, 2020 at 3:17 pm #1760
    abrar akhtarabrar akhtar
    Participant
    This reply has been marked as private.
    April 2, 2020 at 3:52 pm #1764
    Suman M.Suman M.
    Keymaster

    Hi, I have updated XPath for “Next page button” in step 1 (for task clutch.co_web-developers). It should work fine now.

    April 2, 2020 at 4:29 pm #1765
    abrar akhtarabrar akhtar
    Participant

    Thanks for Suman. I have just run the task but however it only seems to get 70 or so posts. Anything I am doing run, i just ran the task? Appreciate your help here. Abrar

    April 3, 2020 at 6:50 am #1767
    Suman M.Suman M.
    Keymaster

    I have set Loop Limit to 10 for the task clutch.co_web-developers so that only 10 posts are fetched in each loop. Also what is PHP memory limit and max execution time limit values of your site/server?

    April 8, 2020 at 9:41 am #1784
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    Apologies for not getting back to you sooner. The 128 MB for Memory Limit

    30 seconds for Max Execution Time.

    Does this work to scrape the full list,or what would be the maximum here in this capacity?

    Thanks,

    Abrar

    April 8, 2020 at 9:53 am #1785
    Suman M.Suman M.
    Keymaster

    Hi, the recommended values are – php memory limit 512MB or more, max execution limit 300 secs or more

    Scraper Requirements

    April 13, 2020 at 3:35 am #1814
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    I have updated the requirements to the recommended settings. If you could set that up without the limit that would be great.

    Thanks,

    Abrar

  • Author
    Posts
Viewing 15 posts - 1 through 15 (of 26 total)
1 2

You must be logged in and have valid license to reply to this topic.

License required for the following item
Scraper - Automatic Content Crawler Plugin for WordPress
Login and Registration Log in · Register