Interesting project and idea to get your users to build your database of URLs and spider them for you using their resources not yours. You just dump the results into your system.
Can someone spider all .co.uk websites in the world and send them to me for my new search engine?
Thanks :lol: