wpBots Support

Helpdesk for Best Scraper Plugin

Search in:
Suggested Search: installation, demo data, icons

Scrape posts from site with password

wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › General Issues › Scrape posts from site with password

Tagged: 

Viewing 15 posts - 1 through 15 (of 22 total)
1 2
  • Author
    Posts
  • September 27, 2019 at 8:38 pm #627
    Roy CostnerRoy Costner
    Participant

    Hi Support,

    We recently purchased this plugin for one of our clients to scrape posts from one of their partner companies.

    The partner company is protected by a simple WordPress password. How can we input a password in order to scrape that site?

    Thanks!
    Roy

    September 28, 2019 at 8:27 am #630
    Suman M.Suman M.
    Keymaster

    Hi, please follow the steps as mentioned here – https://scraper.site/documentation/index.php/using-cookies/
    Let us know if any issue. Thanks!

    October 1, 2019 at 1:09 am #638
    Roy CostnerRoy Costner
    Participant

    Hi Suman!

    This unfortunately did not work, there is no PHPSESSID showing on any of the browsers I have tried (Chrome, Firefox, or Safari). It is a simple WordPress password on cs.tidewatermg.com

    Also, is it possible to scrape all posts on the site? If so how?

    Thanks!
    Roy

    October 1, 2019 at 1:55 am #639
    Roy CostnerRoy Costner
    Participant

    I figured out the cookie issue resolved, now my problem is getting the content to format into columns/table like it is on the source site. Even with JSON enabled, it is not translating correctly.

    Any help is greatly appreciated

    October 1, 2019 at 3:53 am #641
    Suman M.Suman M.
    Keymaster

    Hi, thanks for contacting us. To check this issue we’ll need to look into the your task. So, please let us know your site’s backend login details (as private reply). Also let us know the Task name that you have created, and what exactly do you want to scrape from the source site (screenshot please). Thanks!

    October 1, 2019 at 4:02 am #642
    Roy CostnerRoy Costner
    Participant
    This reply has been marked as private.
    October 1, 2019 at 4:21 am #644
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    October 1, 2019 at 11:41 am #645
    Roy CostnerRoy Costner
    Participant

    My apologies! The login with the name “Austin” is for mapd.southatlanticmgt.com/backend

    The “letmein” password should be for cs.tidewatermg.com

    October 1, 2019 at 7:15 pm #646
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    October 1, 2019 at 8:00 pm #647
    Roy CostnerRoy Costner
    Participant
    This reply has been marked as private.
    October 2, 2019 at 5:44 am #648
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    October 2, 2019 at 1:04 pm #650
    Roy CostnerRoy Costner
    Participant
    This reply has been marked as private.
    October 3, 2019 at 4:45 am #653
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    October 4, 2019 at 12:00 am #655
    Roy CostnerRoy Costner
    Participant

    It is now generating content without duplicating; however I have 3 other issues.

    1. It is not dividing the content into 2 columns side-by-side, is this possible to do?
    2. How can I have it pull the featured image from the list of all posts since the image isn’t viewable on individual post pages?
    3. Lastly, it is only processing 50 at a time and not progressing to the next page, how can I get it to run through all pages?

    Thank you so much for your help!
    Roy

    October 4, 2019 at 12:04 am #656
    Roy CostnerRoy Costner
    Participant

    Also, is there a way for it to pull multiplecategories and subcategories?

  • Author
    Posts
Viewing 15 posts - 1 through 15 (of 22 total)
1 2

You must be logged in and have valid license to reply to this topic.

License required for the following item
Scraper - Automatic Content Crawler Plugin for WordPress
Login and Registration Log in · Register