Scraping to custom post type
wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › General Issues › Scraping to custom post type
- This topic has 16 replies, 3 voices, and was last updated 6 years, 1 month ago by
Suman M..
-
AuthorPosts
-
September 16, 2019 at 10:14 am #543
Celeste LombardParticipantGood day
I have previously purchased Octolooks Scrapes and unfortunately, it did not meet my requirements perfectly and thereafter I purchased your Scraper.
I ask you please to help getting started, I have tried some methods without 100% success.
What I am trying to achieve is to scrape property listings to my sites custom post type “listings”
1) The first issue I am having is not seeing the gallery images on the scrape site. So I cant select them – is there a disable styles option? What to do? I want to scrape a gallery of images to my custom post gallery. Also when the images are scraped they should be hosted on my server and not the hosts right?
2) The second issue is my “listings” have categories/taxonomies for bedrooms/bathrooms/city/property type etc. So how do I scrape these values to my custom post type?
3) What happens when you delete a task, does the scraped data stay?
I have attached a sample of my custom post type metadata.
Your advice is truly appreciated.Attachments:
You must be logged in to view attached files.September 16, 2019 at 6:21 pm #549
Amandeep singhParticipantHi , I am not the owner , But I am also using this plugin . To Post the category , If the category field is not id type and is a text filed in wp_post , Then you can scrap directly. When you delete a task data stays yes ( Data Refer to post ).
September 17, 2019 at 3:03 am #551
Suman M.KeymasterHi Celeste, thanks for contacting us.
1) the content is not displayed in scraper’s visual editor if it’s loaded via Ajax. But still it might be possible to scrape the content. We’ll need to check the source site if it’s possible or not.
2) category – you can select it to Post Category field. For custom variables, you need to select/fill respective custom variable. These variables should be available in ‘Type’ dropdown box – https://www.screencast.com/t/rqGzsQsFG0m
3) already imported data will not be deleted, only the task is deleted.
Is https://vacations.capetown/ your website or the source site from where you want to scrape the content? Please let us know the exact source URL so that we can check.
September 17, 2019 at 5:56 am #557
Celeste LombardParticipantThis reply has been marked as private.September 18, 2019 at 6:06 am #563
Suman M.KeymasterThis reply has been marked as private.September 18, 2019 at 8:24 am #566
Celeste LombardParticipantThis reply has been marked as private.September 19, 2019 at 7:13 am #571
Suman M.KeymasterThis reply has been marked as private.September 19, 2019 at 7:25 am #573
Celeste LombardParticipantThis reply has been marked as private.September 19, 2019 at 7:35 am #574
Celeste LombardParticipantThis reply has been marked as private.September 20, 2019 at 6:15 am #579
Suman M.KeymasterThis reply has been marked as private.September 20, 2019 at 7:49 am #582
Celeste LombardParticipantThis reply has been marked as private.September 21, 2019 at 8:24 am #583
Celeste LombardParticipantThis reply has been marked as private.September 21, 2019 at 4:53 pm #587
Suman M.KeymasterYes, I could login now. Thanks! I’ll check further with the scraper plugin and get back to you.
September 23, 2019 at 8:13 am #591
Celeste LombardParticipantThis reply has been marked as private.September 24, 2019 at 5:48 am #594
Suman M.KeymasterThis reply has been marked as private. -
AuthorPosts
You must be logged in and have valid license to reply to this topic.