wpBots Support

Helpdesk for Best Scraper Plugin

Search in:
Suggested Search: installation, demo data, icons

Scraping json location data

wpBots Support – The best crawlers for WordPress › Forums › SCRAPER (after-sales) › General Issues › Scraping json location data

Viewing 12 posts - 1 through 12 (of 12 total)
  • Author
    Posts
  • September 23, 2019 at 4:06 am #589
    Jordan CoxJordan Cox
    Participant

    I am trying to create posts in my website for recreational rentals.

    I am attempting to scrape the url https://rvshare.com/rvs/details/1133961

    If you view the json data for this url, you can see the coordinates of the listing.

    Can I scrap these coordinates to complete a custom field in my post?

    September 24, 2019 at 6:00 am #595
    Suman M.Suman M.
    Keymaster

    Hi, I checked the URL https://rvshare.com/rvs/details/1133961 and I cannot see any coordinates there? Can you please show it using the screenshot?
    Also, you can scrape/import the data that are visible in the website (scraper visual editor). Let us know. Thanks!

    September 24, 2019 at 6:34 pm #602
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    September 25, 2019 at 6:38 am #607
    Suman M.Suman M.
    Keymaster

    Hi, you cannot scrape such values. Basically, you can only fetch correctly, the data visible in Scraper’s visual editor.
    But you can still fetch some data entering the XPath manually. In above case, it’s not possible to fetch only the geo-coordinates, but I was able to scrape that script block as a whole using below XPath:
    //script[contains(@type,"application/ld+json")][5]

    Screenshots:
    2019-09-25_1220
    2019-09-25_1219

    Also, the scraper is not completing fields from WP Job Manager
    >> What data from source site needs to be mapped to which field in WP job manager?

    Helpful links:

    Custom Fields

    Custom Taxonomies

    • This reply was modified 6 years, 1 month ago by Suman M.Suman M..
    September 25, 2019 at 5:34 pm #611
    Jordan CoxJordan Cox
    Participant

    Hello, this is great! You were able to capture the coordinates it looks like. I Need the following WP Job manager fields to be completed. Once I get on template made I can use this for all the listings on my website. Here are the fields I need…

    job_category (This is a taxonomy)
    job_region (This is a taxonomy)
    job_description_2
    job_price
    job_payment_method
    Can you please take a look and see why it wont complete any of these fields?

    Thank you so much!

    September 26, 2019 at 6:49 am #612
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    September 26, 2019 at 6:54 am #614
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    September 27, 2019 at 4:18 am #616
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    September 27, 2019 at 4:46 am #618
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    September 29, 2019 at 8:15 pm #632
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    October 7, 2019 at 12:29 am #673
    Jordan CoxJordan Cox
    Participant

    Ok, well if I cant get the cooridnates then that is ok. But all of the other fields are not being input when I trigger scrape. The following fields are not working…

    job_category (This is a taxonomy)
    job_region (This is a taxonomy)
    job_description_2
    job_price
    job_payment_method

    Can you please take a look and see why it wont complete any of these fields?

    October 9, 2019 at 6:13 am #682
    Suman M.Suman M.
    Keymaster

    Please define like this – https://www.screencast.com/t/KqYSzuPq (select correct field value for it from the site)

    More info here – scraper.site/documentation/index.php/custom-taxonomies/

  • Author
    Posts
Viewing 12 posts - 1 through 12 (of 12 total)

You must be logged in and have valid license to reply to this topic.

License required for the following item
Scraper - Automatic Content Crawler Plugin for WordPress
Login and Registration Log in · Register