Posts

Showing posts with the label archive web pages in bulk

2026-02-12: How to archive web pages in bulk using the Internet Archive Google Sheets service

Image
Results of archiving web pages using the Wayback Machine Google Sheets service One of the greatest services the Internet Archive (IA) offers is the Save Page Now (SPN) service . It is easy to use and it was completely overhauled in 2019 with added features . However, the UI is limited to archiving a single URL at a time. To overcome this limitation, the IA launched the  Google Sheets service , which allows you to submit a Google Sheet with the first column full of URLs (up to 5,000 URLs), and it will archive them all in the Wayback Machine. I needed to archive 1.5 million URLs that I collected from four Arabic and English news websites published between 1999 and 2022 . This is obviously not doable one URL at a time, but the IA's Google Sheets service makes it possible. because I can archive 5,000 URLs at a time and up to 30.000 URLs (six sheets) per day. The first step is to create a Google sheet and paste the URLs you need to archive in the first column (one URL in each row)...