Is it possible to scrape my own site?
wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (pre-sales) › General enquiry › Is it possible to scrape my own site?
- This topic has 9 replies, 2 voices, and was last updated 4 years, 9 months ago by Suman M..
-
AuthorPosts
-
March 22, 2020 at 4:36 am #1647evan lazyParticipant
Hi, I am working with https://chulavistacoins.com
I have a table setup in tablepress that syncs every 15 minutes with a google sheet (displayed with a shortcode). I would like my scraper to scrape that data in the table (on the homepage) so that every silver price on the entire site is the same.
Is it possible to scrape from a something displayed from a shortcode?
Also I am getting errors when I use “trigger once”. I’ve followed the steps in the setup.
Additionally, when I “scrape” a page with the button “scrape”, the page that comes up is unscrollable. It doesn’t move at all.
Attachments:
You must be logged in to view attached files.March 22, 2020 at 4:48 am #1656Suman M.KeymasterHi, you have enabled “error reporting” and that’s why you are seeing that log. But scrape seems to be working as t’s returning HTTP Code:200
Please disable “error reporting” from License and Settings tab.Regarding your requirement, I didn’t get it exactly what you are trying to achieve. Can you please explain with examples and screenshots if possible?
You can also use shortcode feature in the Scraper plugin – https://support.wpbots.net/documentation/creating-dynamic-wordpress-shortcode/March 23, 2020 at 5:04 pm #1679evan lazyParticipanti sent a private reply…is there a reason it’s not showing up even though I am logged in?
March 23, 2020 at 5:07 pm #1686evan lazyParticipantnone of my replies are posting! what do i do?
March 23, 2020 at 5:11 pm #1692evan lazyParticipantim trying to send a detailed reply but its not working! i need help with this plugin
March 23, 2020 at 6:30 pm #1693evan lazyParticipantthis plugin barely works. i cant even submit a ticket response because each time i type something out very long it doesn’t work!!!
March 23, 2020 at 8:46 pm #1707evan lazyParticipanti am attempting to scrape a google sheet…i doubt this will be seen because every time i try to type a long reply it just doesn’t show up and scrolls me to the top of this page.
every time i try to scrape a google sheet TAB it just gives me white screen. i’ve tried scraping the google sheet as a web page, tsv, csv, pdf etc. the only thing that sort of works is web page. i cannot scroll up and down the “web page”. it shows me a cut off version of the google sheet. ive tried publishing the document every way and i’ve tried pasting all the different URL’s that google sheets comes up with. none of this is working
March 23, 2020 at 8:54 pm #1708evan lazyParticipanti would like to be able to edit my comments, it appears like for some reason my original comment just wont get published (copy and pasted)…if i could edit my comments i wouldnt have to send so many replies because it appears like im spamming this thread which is not my intent.
now the auto sync’ing is not working. it’s supposed to scrape every 15 minutes but it just wont work.
This is an image of what I see. I can’t scroll or zoom or interact with this “web page” at all. Is this plugin not intended to work with google sheets?
Additionally I cannot scrape even my own site. If scraping a google sheet isn’t an option, why won’t it even let me scrape my own site?
March 25, 2020 at 5:36 am #1715Suman M.KeymasterHi, sorry for getting back little late to you on this. If you are not being able to post here the long content (which might be dues to some keywords or links in it), then please email us directly to support@wpbots.net
Regarding the issue, Can you please let us know your site’s backend login details (as private reply) so that we can look into it further.
It does work with google sheets. What’s your website url that’s not being scraped?
March 25, 2020 at 5:37 am #1716Suman M.KeymasterHi, sorry for getting back little late to you on this. If you are not being able to post here the long content (which might be due to some keywords or links in it), then please email us directly to support@wpbots.net
Regarding the issue, Can you please let us know your site’s backend login details (as private reply) so that we can look into it further.
It does work with google sheets. What’s your website url that’s not being scraped?
- This reply was modified 4 years, 9 months ago by Suman M..
-
AuthorPosts
- You must be logged in to reply to this topic.