Posts

2018-07-18: Why We Need Private Web Archives: Almost Two-Thirds of Web Traffic IS NOT Publicly Archivable

Image
Google.com mementos from May 8th 1999 on the Internet Archive In terms of the ability to be archived in public web archives, web pages fall into one of two categories: publicly archivable, or not publicly archivable. 1. Publicly Archivable Web Pages: These pages are archivable by public archives. The pages can be accessed without login/authentication. In other words, these pages do not reside behind a paywall. Grant Atkins examined paywalls in the Internet Archive for news sites and found that web pages behind paywalls may actually be redirecting to a login page at crawl time. A good example of a publicly archivable page is   Dr. Steven Zeil's page  since no authentication is required to view the page. Furthermore, it does not use client-side scripts (i.e., Ajax) to load additional content, so what you see in the web browser and what you can replay from public web archives are exactly the same. Screen shot from  Dr. Steven Zeil's page  captured on 2018-07-02

2018-07-15: How well are the National Guideline Clearinghouse and the National Quality Measures Clearinghouse Archived?

Image
On July 13, I saw this on Twitter: On Monday, doctors, nurses and researchers will lose access to a trove of medical data, as the Trump Administration shuts down the National Guidelines Clearinghouse. See our piece today, by our Senior Investigator @j0ncampbell , in @TheDailyBeast : https://t.co/Qz1tkRIQIM — Sunlight Web Integrity Project (@SunWebIntegrity) July 12, 2018 There are two US government websites in danger, the National Guideline Clearinghouse ( https://www.guideline.gov ) and the National Quality Measures Clearinghouse ( https://qualitymeasures.ahrq.gov ). Both store medical guidelines. Both will "not be available after July 16, 2018". According to the linked Daily Beast article above: Medical guidelines are best thought of as cheatsheets for the medical field, compiling the latest research in an easy-to-use format. When doctors want to know when they should start insulin treatments, or how best to manage an HIV patient in unstable housing — even somet