Web Science and Digital Libraries Research Group

Figure 1: The Browsertrix Tool Suite For the Saving Ads project and the Game Walkthroughs and Web Archiving project , we have used Browsertrix Crawler , ArchiveWeb.page , and ReplayWeb.page , which are Webrecorder tools that were discussed in Walsh et al.’s paper “ High Fidelity Web Archiving of News Sites and New Media with Browsertrix .” In this paper, Walsh et al. describe tools that are integrated with Browsertrix and the features that differentiated their tools from other web archive crawlers and replay systems. Browsertrix is a free and open-source web archiving platform that can be run locally , self-hosted , or used through Webrecorder's hosted service . Browsertrix uses Browsertrix Crawler for archiving web pages, ArchiveWeb.page to patch archived web pages, and ReplayWeb.page to replay archived web pages (Figure 1). Walsh, Tessa, Henry Wilkinson, and Ilya Kreymer. “High Fidelity Web Archiving of News Sites and New Media with Browsertrix.” in Proceedings of the 2024 Int...

Figure 1: Example of an image pair from Reyes Ayala’s dataset of a live web page (left screenshot) and an archived web page (right screenshot) . For the Game Walkthroughs and Web Archiving project , we have created web archiving livestreams ( example livestream ) that use tools to measure the performance of a web archive crawler during the livestream. In a previous blog post , I compared six different approaches for measuring web archiving and replay performance metrics so that I could identify tools that could be used during our future web archiving livestreams. In this post, I will summarize another related work (“ Towards a better QA process: Automatic detection of quality problems in archived websites using visual comparisons ”) by Brenda Reyes Ayala that determines the quality of an archived web page by comparing screenshots of the live web page and archived web page.   Reyes Ayala, B. (2025). Towards a better QA process: Automatic detection of quality problems in archived we...

  Figure 1: Six articles and the type of web archiving and replay performance metrics that they included in their work. For the Game Walkthroughs and Web Archiving project , we have created web archiving livestreams ( example livestream ) that use tools to measure the performance of web archiving and replay systems, so that we can see which crawler had better performance during the livestream. In this post, we categorize and survey six related works that include performance metrics related to web archiving and replay quality (Figure 1). The four categories shown in Figure 1 are archivability , completeness , visual correspondence , and interactional correspondence . Three of these categories, visual correspondence, completeness, and interactional correspondence, for measuring web archiving and replay performance are associated with Reyes Ayala ’s grounded theory (Paper: " Correspondence as the primary measure of information quality for web archives: A human-centered grounded theo...