Checking connectivity to source website
In some cases, the source site may block you. In that case, you may use proxy and continue to scraping. To check connectivity to source site please follow instructions below :
- Create a sample task with “single-post” option.
- As a post title, select any title from website, you could write //h1 on path for example.
- Trigger this task to create new post on your website.
- If it creates a task with the title you want, there shouldn’t be any connection issue.
You could also see errors when you trigger task. Please enable reporting on settings page to see detailed logs.
If there is a connection issue to source site, you could simply define proxy and continue scraping.