Archive for the ‘Servers’ Category

First crawl!

December 18, 2007

So Jimmy announced today on the mailing list that “we are now doing some preliminary crawls in anticipation of the upcoming launch.” A wiki page was also created at http://search.wikia.com/wiki/Whitelist and everyone has been asked to contribute towards the list of pages to be crawled by the new servers.

Jimmy continued in the email saying, “Information is going to change quickly in the next 2-3 weeks, but I’m getting excited.”

1000 servers?!?!

December 17, 2007

The screen shot below shows a picture by Jimmy Wales uploaded to Flickr (here) with the caption “Hmmm, what could nearly 1000 servers be for?”. Also on the Search Wikia mailing list when asked “Any updates on the Wikia search project…?” Jimmy replied “On track, we are hard at work right now…” with a link to the image shown. Many people have speculated that this is for a crawl and/or Hadoop cluster and this was confirmed by Jimmy Wales on IRC when I asked if the servers were for a web crawl he replied “they are for the wikia search web crawl, yes”.

(Click to enlarge)

Loading the truck