Scraping json location data

Viewing 12 posts - 1 through 12 (of 12 total)
  • Author
    Posts
  • #589
    Jordan CoxJordan Cox
    Participant

    I am trying to create posts in my website for recreational rentals.

    I am attempting to scrape the url https://rvshare.com/rvs/details/1133961

    If you view the json data for this url, you can see the coordinates of the listing.

    Can I scrap these coordinates to complete a custom field in my post?

    #595
    Suman M.Suman M.
    Keymaster

    Hi, I checked the URL https://rvshare.com/rvs/details/1133961 and I cannot see any coordinates there? Can you please show it using the screenshot?
    Also, you can scrape/import the data that are visible in the website (scraper visual editor). Let us know. Thanks!

    #602
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    #607
    Suman M.Suman M.
    Keymaster

    Hi, you cannot scrape such values. Basically, you can only fetch correctly, the data visible in Scraper’s visual editor.
    But you can still fetch some data entering the XPath manually. In above case, it’s not possible to fetch only the geo-coordinates, but I was able to scrape that script block as a whole using below XPath:
    //script[contains(@type,"application/ld+json")][5]

    Screenshots:
    2019-09-25_1220
    2019-09-25_1219

    Also, the scraper is not completing fields from WP Job Manager
    >> What data from source site needs to be mapped to which field in WP job manager?

    Helpful links:

    Custom Fields

    Custom Taxonomies

    • This reply was modified 2 years, 4 months ago by Suman M.Suman M..
    #611
    Jordan CoxJordan Cox
    Participant

    Hello, this is great! You were able to capture the coordinates it looks like. I Need the following WP Job manager fields to be completed. Once I get on template made I can use this for all the listings on my website. Here are the fields I need…

    job_category (This is a taxonomy)
    job_region (This is a taxonomy)
    job_description_2
    job_price
    job_payment_method
    Can you please take a look and see why it wont complete any of these fields?

    Thank you so much!

    #612
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    #614
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    #616
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    #618
    Jordan CoxJordan Cox
    Participant
    This reply has been marked as private.
    #632
    Suman M.Suman M.
    Keymaster
    This reply has been marked as private.
    #673
    Jordan CoxJordan Cox
    Participant

    Ok, well if I cant get the cooridnates then that is ok. But all of the other fields are not being input when I trigger scrape. The following fields are not working…

    job_category (This is a taxonomy)
    job_region (This is a taxonomy)
    job_description_2
    job_price
    job_payment_method

    Can you please take a look and see why it wont complete any of these fields?

    #682
    Suman M.Suman M.
    Keymaster

    Please define like this – https://www.screencast.com/t/KqYSzuPq (select correct field value for it from the site)

    More info here – scraper.site/documentation/index.php/custom-taxonomies/

Viewing 12 posts - 1 through 12 (of 12 total)

You must be logged in and have valid license to reply to this topic.

License required for the following item
Login and Registration Log in · Register