Posted 20 Dec 2009 in big picture

The internet contains a huge amount of useful data but most is not easily accessible. Web scraping involves extracting this data from websites into a structured format.

Here are some typical use cases for web scraping:

  • Extract business contact details from Yellow Pages into a CSV spreadsheet
  • Extract reviews from Google Places into a MySQL database
  • Extract product prices from Amazon so your company can price match
  • Track what people are saying about your product on Twitter and Facebook

If this sounds interesting then feel welcome to contact me to discuss further.