# Common Crawl

<https://commoncrawl.org/>

- Host: [commoncrawl.org](https://links.thingelstad.xyz/hosts/commoncrawl.org/)
- Saved: March 30, 2021 (2021-03-30T22:23:54Z)
- Record: https://links.thingelstad.xyz/links/a2299df0faa6/
- JSON: https://links.thingelstad.xyz/links/a2299df0faa6.json

## What Jamie wrote

A compelling non-profit that I am honestly surprised I wasn't aware of. They are crawling the web, like the search engine giants do, but as a non-profit and making the data available for others to use. This reminds me a bit of what [Internet Archive](https://archive.org) does but for a very different purpose. Having a huge set of data like this *should* lower the barrier to Internet scale projects like new search engines. You can [donate here](https://commoncrawl.org/donate/).

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT180: Weekly Thing #180 / Tetris, Ever Given, Backstory](https://weekly.thingelstad.com/archive/180/), Recommended Links

## Saved the same week

- [What Does It Mean To Buy a Gif? | Jack Rusher](https://links.thingelstad.xyz/links/1c1398e78d9b/) (jackrusher.com, March 30, 2021)
- [The Ship Stuck in the Suez Canal Is Glorious - The Atlantic](https://links.thingelstad.xyz/links/ce1e53f7a33a/) (theatlantic.com, March 30, 2021)
- [Annie's Mac and Cheese is based in the Bay Area, but Annie is not. Here's her story.](https://links.thingelstad.xyz/links/f1dd37a899a0/) (sfgate.com, March 30, 2021)
- [I Like That The Boat Is Stuck](https://links.thingelstad.xyz/links/de590236167e/) (stone-soup.ghost.io, March 30, 2021)
- [Ethernet and IP Networking 101](https://links.thingelstad.xyz/links/4dc6a0761245/) (iximiuz.com, March 30, 2021)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://commoncrawl.org/
