Good article. I would add a caveat that you should never web scrape if there's an API available. I've been in situations where I needed to convince web site authors to create APIs for me. It too time, but it was worth it in the end.