Web Science and Digital Libraries Research Group

  Figure 1: Web archiving process augmented with FidEx. Figure from https://www.usenix.org/system/files/nsdi26-zhu-jingyuan.pdf . To improve the annotation feature for our web archiving livestreams , I have been looking at different Quality Assurance tools that detect replay problems and explain why specific resources fail to load. Most of the Quality Assurance tools that determine the quality of the archived web page do not specify the reason why each web resource failed to load. Zhu et al.’s FidEx tool and Archive-It's Wayback QA tool try to assist with this problem. Zhu, Sun, and Madhyastha’s paper " Detecting and Diagnosing Errors in Serving Archived Web Pages " describes their approach (Figure 1) for detecting problems with replay quality that are caused by rewriting errors made by the replay system. Their approach involves comparing the layout trees ( HTML DOM [Document Object Model] and CSSOM [CSS Object Model]) and the JavaScript writes for the live and archi...

Figure 1: The Browsertrix Tool Suite For the Saving Ads project and the Game Walkthroughs and Web Archiving project , we have used Browsertrix Crawler , ArchiveWeb.page , and ReplayWeb.page , which are Webrecorder tools that were discussed in Walsh et al.’s paper “ High Fidelity Web Archiving of News Sites and New Media with Browsertrix .” In this paper, Walsh et al. describe tools that are integrated with Browsertrix and the features that differentiated their tools from other web archive crawlers and replay systems. Browsertrix is a free and open-source web archiving platform that can be run locally , self-hosted , or used through Webrecorder's hosted service . Browsertrix uses Browsertrix Crawler for archiving web pages, ArchiveWeb.page to patch archived web pages, and ReplayWeb.page to replay archived web pages (Figure 1). Walsh, Tessa, Henry Wilkinson, and Ilya Kreymer. “High Fidelity Web Archiving of News Sites and New Media with Browsertrix.” in Proceedings of the 2024 Int...

  Figure 1: Six articles and the type of web archiving and replay performance metrics that they included in their work. For the Game Walkthroughs and Web Archiving project , we have created web archiving livestreams ( example livestream ) that use tools to measure the performance of web archiving and replay systems, so that we can see which crawler had better performance during the livestream. In this post, we categorize and survey six related works that include performance metrics related to web archiving and replay quality (Figure 1). The four categories shown in Figure 1 are archivability , completeness , visual correspondence , and interactional correspondence . Three of these categories, visual correspondence, completeness, and interactional correspondence, for measuring web archiving and replay performance are associated with Reyes Ayala ’s grounded theory (Paper: " Correspondence as the primary measure of information quality for web archives: A human-centered grounded theo...