With most race results now being published on the web I set up some processes to import data automatically into Canterbury Harriers’ results system. Recently, however, I was getting a “403 Forbidden” response from one such site which had obviously decided to cut down on “scraping”. This was particularly irritating as our system was only… Continue reading Using ProxyCrawl to get Webpages