We specialize in extracting data from websites,
which is known as web scraping.

Whatever you see on the internet can be extracted.
And whatever you do can be automated.

Read here to learn what is possible.
Looking for a database? Check the data store.

Need data scraped from a particular website?
Request A Quote
Recently purchased databases
Famous quotes

A list of 86,055 famous quotes across various categories - alcohol, romance, travel, etc.

Price: $50.00

More info

Universal Product Codes (UPC) details

A list of over 6 million Universal Product Codes (UPC) and their product details.

Price: $100.00

More info

Android apps

Details of over half a million Android apps.

Price: $100.00

More info

Recent blog posts
Generating a website screenshot history

There is a nice website screenshots.com that hosts historic screenshots for many websites This post will show how to generate our own historic screenshots with python.

Read More

Web Scraping User Interface

When scraping a website, typically the majority of time is spent waiting for the data to download So to be efficient I work on multiple scraping projects simultaneously.

Read More

Automatically import a CSV file into MySQL

Sometimes I need to import large spreadsheets into MySQL The easy way would be to assume all fields are varchar, but then the database would lose features such as ordering by a numeric field. The hard way would be to manually determine the type of each field to define the schema.

Read More