This set of slides by Daniel Naber from his talk at JAZOON07 provides a nice overview on the Apache projects Lucene, Solr and Nutch:

http://www.danielnaber.de/publications/jazoon07_naber.pdf