Web Science and Digital Libraries Research Group

    I've previously written about the Memento Damage project, originally started by Dr. Justin Brunelle , a Web service designed to estimate the amount of damage to a web archive by assessing it's missing resources. Previously, I had been specializating some of the project  while working on the Memento Tracer project, funded by the Alfred P. Sloan Foundation , to take special considerations regarding the damage weighting for Web hosted repository pages.  I have been making further updates to the Memento Damage project over the course of this year that helps improve this analysis and damage estimation. The most prominent is the implementation of a secondary crawler component for analyzing an archived repository and its source tree. Web-hosted Git repositories are hosted on centralized Web platforms, the largest being GitHub along with other major platforms such as GitLab, Bitbucket, and Sourceforge. The source files for a Git project are hosted "behind the scen...

Hello Internet and Archivists!      I'm back for another blog post and I'm excited to share some overhauls, updates, and research that I have been working on for the Memento Damage service, previously developed by Dr. Justin Brunelle , Erika Siregar , and Grant Atkins . The project page is still currently running the original project build but I wanted to share some behind-the-scenes updates before we roll out the new build soon! Under the Hood Fig. 1: Homepage for the Memento Damage web service      When I took on this project, there were many components needing update due to age; the code base had been on Python version 2 still as it had sat over the years as Dr. Brunelle and previous students had graduated and moved on to other endeavors. Updating the code base to Python version 3 was one of the top to-do items! Over a lot of time learning the code base and refactoring I was able to clean up and modernize the code a bit thanks to the syntax and language...

We are happy to announce that our new collaboration between the New York University (NYU) Division of Libraries , the Research Library's Prototyping Team at Los Alamos National Laboratory (LANL) , the University of Pittsburgh ’s Computer Science Department , and the Web Science and Digital Libraries (WDSL) Research Group has been funded by the Alfred P. Sloan Foundation with an amount of $520,000. The two-year project titled “Collaborative Software Archiving for Institutions (CoSAI)” is led by co-PIs Vicky Rampin (Librarian for Research Data Management and Reproducibility, NYU) and Martin Klein (Research Scientist, LANL), in collaboration with the wilkie from the Open Curation of Computation and Metadata (OCCAM) initiative at the University of Pittsburgh and WSDL’s Michael L. Nelson and Michele Weigle from ODU. In addition, we are thrilled to welcome Talya Cooper and Emily Escamilla to the CoSAI team. CoSAI will focus on institutional approaches to provide machine-re...