Scraper data
wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › General Issues › Scraper data
- This topic has 14 replies, 2 voices, and was last updated 6 years, 1 month ago by
Suman M..
-
AuthorPosts
-
September 16, 2019 at 12:23 am #540
Amandeep singhParticipantHi , Scraper is not posting all the data and data posted is not discoverable by site.
September 16, 2019 at 3:58 am #541
Amandeep singhParticipantHi , How to save the source URL.
September 16, 2019 at 4:44 am #542
Suman M.KeymasterHi, can you please explain this – “data posted is not discoverable by site”? Isn’t the content not at all imported after you hit Run button?
How to save the source URL
>> There’s a tag {{source_url}} available which you can use in Shortcodes Tab section. Example: https://www.screencast.com/t/9SoLWZQKSeptember 16, 2019 at 12:11 pm #545
Amandeep singhParticipantThis reply has been marked as private.September 16, 2019 at 12:18 pm #546
Amandeep singhParticipantThis reply has been marked as private.September 16, 2019 at 2:23 pm #547
Amandeep singhParticipantThis reply has been marked as private.September 16, 2019 at 6:06 pm #548
Amandeep singhParticipantHi , Custom variable are not saving the data to the database.And I have deleted some posts that it scrape earlier , and I try to scrap same page again and it saying it is already processed. Can you point out the file it has saved the already processed post logs.
Your Support is Truly Appreciated !
RegardsSeptember 17, 2019 at 1:54 am #550
Amandeep singhParticipantHi , I can share the wordpress login for the site , if you want to try yourself.
September 17, 2019 at 3:20 am #552
Suman M.Keymasterwhere does scraper is saving already posted data. How to clear it.
>> Scraper imports the content as post or custom post type (that you define in scraper). So data isn’t stored anywhere else but as posts or custom post type only.Source URL is scraping the URL , but how to post this to database with custom variable. Do I need to create a column and use the name as short code.
>> {{source_url}} shortcode can’t be saved as custom variable. You’ll need to define a separate custom variable, and select the source url from the visual editor (source site)Custom variable are not saving the data to the database.And I have deleted some posts that it scrape earlier , and I try to scrap same page again and it saying it is already processed. Can you point out the file it has saved the already processed post logs.
>> Please let us know which custom variables are not being saved? If it says “already processed”, then try resetting the task. You can also choose to auto reset task while saving task (https://www.screencast.com/t/nYxaj0cHWFBL). There is no such log available.If you are still having issue, then please let us know your site’s backend details. Thanks!
September 17, 2019 at 3:48 am #553
Amandeep singhParticipantThis reply has been marked as private.September 17, 2019 at 3:48 am #554
Amandeep singhParticipantThis reply has been marked as private.September 17, 2019 at 4:10 am #555
Amandeep singhParticipantThis reply has been marked as private.September 18, 2019 at 5:01 am #560
Suman M.KeymasterThis reply has been marked as private.September 18, 2019 at 5:26 am #561
Amandeep singhParticipantGreat , All expected issue are solved. This plugin is great. Many thanks
September 18, 2019 at 5:40 am #562
Suman M.KeymasterThanks! It’s my pleasure helping you out.
-
AuthorPosts
You must be logged in and have valid license to reply to this topic.