Multiple post not working

Viewing 15 posts - 1 through 15 (of 26 total)
  • Author
    Posts
  • #1665
    abrar akhtarabrar akhtar
    Participant

    Hi,

    I am trying to scrape this site clutch.co. When I click on Single Post then the page loads up and I am able to scrape a single post. If I click Multiple Post then the page disappears then it says: ‘Please select serial item link or enter content link first! Go to Feed section, select pick tool for serial item on sidebar, select your feed post’s link.’

    I have attached the screen shots below.

    Please let me know what the issue is.

    Cheers,

    Abrar

    Attachments:
    You must be logged in to view attached files.
    #1670
    Suman M.Suman M.
    Keymaster

    Hi, thanks for contacting us. Can you please let us know what serial items you want to scrape from clutch.co so that we can help you with creating the scraper task?

    #1672
    abrar akhtarabrar akhtar
    Participant

    Hi, I want to scrape all the names of the companies listed there:
    – the names of the company plus
    – the one liner of the company
    – the tags related to the company such as verified, revenue along the right side of the entry.

    thanks,

    Abrar

    #1710
    Suman M.Suman M.
    Keymaster

    Okay got it. In that case you’ll need to scrape from pages like https://clutch.co/web-developers
    I checked it and could scrape from it – https://www.screencast.com/t/iHLBIMfQkJxd

    Please follow this tutorial – https://support.wpbots.net/documentation/create-a-task-on-scraper/
    Let us know if any issue.

    #1740
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    Yes if you see from my previous screenshot that is the URL that I am trying to scrape from but I am getting the same message. If you don’t mind could you record a quick video of yourself going through the steps on clutch.co/web-developers from step 1?

    Thanks,

    Abrar

    #1743
    Suman M.Suman M.
    Keymaster

    Hi, please let us know your site’s wp-admin login details (as private reply) so that we can create a scraper task for you. Thanks!

    #1744
    abrar akhtarabrar akhtar
    Participant
    This reply has been marked as private.
    #1747
    Suman M.Suman M.
    Keymaster

    Hi, I’ve created a task “clutch.co_web-developers” in your site. Please check and let us know if any issue.

    #1760
    abrar akhtarabrar akhtar
    Participant
    This reply has been marked as private.
    #1764
    Suman M.Suman M.
    Keymaster

    Hi, I have updated XPath for “Next page button” in step 1 (for task clutch.co_web-developers). It should work fine now.

    #1765
    abrar akhtarabrar akhtar
    Participant

    Thanks for Suman. I have just run the task but however it only seems to get 70 or so posts. Anything I am doing run, i just ran the task? Appreciate your help here. Abrar

    #1767
    Suman M.Suman M.
    Keymaster

    I have set Loop Limit to 10 for the task clutch.co_web-developers so that only 10 posts are fetched in each loop. Also what is PHP memory limit and max execution time limit values of your site/server?

    #1784
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    Apologies for not getting back to you sooner. The 128 MB for Memory Limit

    30 seconds for Max Execution Time.

    Does this work to scrape the full list,or what would be the maximum here in this capacity?

    Thanks,

    Abrar

    #1785
    Suman M.Suman M.
    Keymaster

    Hi, the recommended values are – php memory limit 512MB or more, max execution limit 300 secs or more

    Scraper Requirements

    #1814
    abrar akhtarabrar akhtar
    Participant

    Hi Suman,

    I have updated the requirements to the recommended settings. If you could set that up without the limit that would be great.

    Thanks,

    Abrar

Viewing 15 posts - 1 through 15 (of 26 total)

You must be logged in and have valid license to reply to this topic.

License required for the following item
Login and Registration Log in · Register