Web crawling on-demand:
80legs is a web crawling and processing service that puts the power of 50,000 computers to use at a fraction of the cost.
The costs of crawling are expressed in terms of pages (basically URIs) and CPU time. But there’s no mention of the correlation between the number of pages and CPU-time.
