Table Of Contents

Related projects

Name / Link	Description
Abika	P2P searching by people
Freenet	A Distributed Anonymous Information Storage and Retrieval System.
GPU	Distributed search engine as a Gnutella Processing Unit (Windows/Delphi)
Hadoop	Hadoop is a framework for running applications on large clusters of commodity hardware. Hadoop is a Lucene sub-project that contains the distributed computing platform that was formerly a part of Nutch. This includes the Hadoop Distributed Filesystem (HDFS) and an implementation of map/reduce. MapReduce is a distributed platform for high volume data processing. Using map/reduce for searching is discussed here
Iuron	another dead project which proposes distributed crawling but central knowledge base
Maay	Maay is a peer-to-peer system that builds an open and dynamic information space and provides a personalized search.
Majestic-12	Distributed crawlers, centralized index
Minerva	Research project for a P2P-based search engine
Minty	seems to have died, from archive.org
Nutch	Nutch is an effort to build an open source search engine based on Lucene Java for the search and index component. It is not distributed atm.
Openp2p's list of distributed search engines
Yacy	active project, distributed search with emphasis on censorship (no anonymity)

Related publications

• P2P Search Engines
• Peer-to-peer searching
• http://en.wikipedia.org/wiki/Peer-to-peer
• http://en.wikipedia.org/wiki/Anonymous_p2p
• Computing Trusted Authority Scores in Peer-to-Peer Web Search Networks (pdf)
• Webminds collection of search related papers
• An Open Publishing Work
• Design and Implementation of a Secure, Decentralized Location Service for Agent Platforms
• Protecting Your Search Privacy: A Flowchart To Tracks You Leave Behind
• The web interface to AOL's 500K user search logs
• distributed / p2p pagerank algorithms
• challenges on distributed web retrieval
• parallel crawlers
• Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers.
• Kademlia is a distributed hash table for decentralized p2p computer networks
• search optimisation in distributed networks (through superpeers)
• the tao of topic maps
• parallel analysis with sawzall
• Yahoo research on distributed web search points to three interesting articles
• why writing your own search engine is so hard
• socialized.net Routing in the network is based on knowledge about other node's interests, making it work much in the same way as humans cooperate.

News and discussions

• Germany Quits EU-Based Search Engine Project
• http://evolvingtrends.wordpress.com/2006/12/14/p2p-to-destroy-ebay-google-yahoo-et-al/[P2P to destroy ebay google yahoo et al]]
• newsarticle about majestic12
• Google wants to really get to know you
• Google plays cat and mouse with regulators

Various

• google ranking factors (by SEO's)
• http://www.p2pfoundation.net
• http://googlesystem.blogspot.com/
• http://www.isoc.nl/ - internet society nederland