Web Science and Digital Libraries Research Group

The Web Archiving and Search Personalized system automatically captures, archives, and indexes pages for both full-text search and replay. (Source: Kiesel et al., Figure 1a) According to a study conducted by Teevan et al. in 2007, 39% of search queries represent users trying to re-find previously viewed pages [1]. One approach to supporting users in this task is automatic personal web archiving. Each page that the user visits is saved, so that it can be found later, similar to an automated version of the "bookmark as archive" feature in Mabe et al.’s Memento-aware browser prototype [2]. However, creating a system that can save web pages as they are viewed, index them for full-text search, and replay them later is an ambitious goal. Johannes Kiesel ( @KieselJohannes ), Arjen P. de Vries ( @arjenpdevries ), Matthias Hagen ( @matthias_hagen ), Benno Stein ( @bennostein ), and Martin Potthast ( @martinpotthast ) created a prototype system for this purpose in their paper “Web Arc...

  In this figure, nine document versions (grey) are shown ordered with respect to time. The versions have different term frequencies, represented by the score axis. The nine original versions are coalesced into three versions (black) in the inverted index. (Source: Berberich , Figure 3.3) According to a user survey conducted by the National Library of the Netherlands in 2007, full-text search is the top requested feature for web archives. Some web archives do allow for the public to perform full-text searches, while other web archives only allow the public to search by website address. For web archives that have implemented full-text search, every version of a document may be indexed, regardless of the similarity between consecutive document versions. In “ Temporal Search in Web Archives ” (2010), Berberich develops time-travel text search to improve searching in web archives. What extensions to existing architecture will support full-text search with respect to time across vers...