Archive for the ‘Hadoop’ Category

1000 servers?!?!

December 17, 2007

The screen shot below shows a picture by Jimmy Wales uploaded to Flickr (here) with the caption “Hmmm, what could nearly 1000 servers be for?”. Also on the Search Wikia mailing list when asked “Any updates on the Wikia search project…?” Jimmy replied “On track, we are hard at work right now…” with a link to the image shown. Many people have speculated that this is for a crawl and/or Hadoop cluster and this was confirmed by Jimmy Wales on IRC when I asked if the servers were for a web crawl he replied “they are for the wikia search web crawl, yes”.

(Click to enlarge)

Loading the truck