Architecture of the internet archive

The Internet Archive is a live production system support- ing close to a petabyte of data and delivering an average of 2.3Gb/sec of data to Internet users. We describe the archi- tecture of this system with an emphasis on its robustness and how it is managed by a very small team of systems personnel. Notably, the current system does not employ a cache. We analyze the reasons for this decision and show that an e!ective cache could not be built until now. How- ever, new solid state disk technology may o!er promising new cache implementations.