Posts

2025-06-10: The Wayback Machine is now much larger than the sum of all other web archives

Image
The overlap in web archives holdings of URIs in our sample In this post, we summarize our study on the archiving rate of news stories published in Arabic and English from four major news outlets, Aljazeera Arabic , Aljazeera English , Alarabiya , and Arab News . We found that 45% of news stories' URIs published between 1999 and 2022 were not archived at all. Furthermore, for news stories published between 1999 and 2013, 65% of them were not archived.  For stories published between 2013 and 2022, only 21% of them are not archived. Our findings line up with  Ainsworth et al. (2011) . who found that between 30% and 90% of the web is archived. Our results indicate a notable improvement in web archiving within the last decade, however, we found that improvement to be limited to the Internet Archive. An earlier study by Alsum et al. (2014) , on a different dataset, found that it is possible to retrieve full TimeMaps for 55% of their dataset using the top three web archives excl...

2024-02-07: LangChain: A Framework to Build Applications with LLMs

Image
Figure 1: LangChain Components In the world of artificial intelligence, one game-changing innovation has been grabbing everyone's attention and transforming the way we interact with language – Large Language Models (LLMs). But for developers, harnessing their full potential has often been very challenging. LangChain is a framework for building applications powered by LLMs that makes it easier for developers to use LLMs. For those skilled in Python, JavaScript, or TypeScript programming languages, LangChain provides packages that developers, software engineers, and data scientists can leverage. Overview of LangChain LangChain offers an advanced framework for engaging with LLMs, external libraries, prompts, and user interfaces. It is available in Python or JavaScript (TypeScript) packages. LangChain's user-friendly architecture allows users to utilize its various components such as agents and chains, and strategically assemble them to fulfill specific tasks like summarization, Q...