# One Trillion Edges: Graph Processing at Facebook-Scale

<http://www.vldb.org/pvldb/vol8/p1804-ching.pdf>

- Host: [vldb.org](https://links.thingelstad.xyz/hosts/vldb.org/)
- Saved: August 21, 2015 (2015-08-21T21:35:19Z)
- Record: https://links.thingelstad.xyz/links/f93f2b50b5eb/
- JSON: https://links.thingelstad.xyz/links/f93f2b50b5eb.json

## From the page (probably an excerpt, not Jamie's words)

Analyzing large graphs provides valuable insights for social networking and web companies in content ranking and rec- ommendations. While numerous graph processing systems have been developed and evaluated on available benchmark graphs of up to 6.6B edges, they often face significant dif- ficulties in scaling to much larger graphs. Industry graphs can be two orders of magnitude larger - hundreds of bil- lions or up to one trillion edges. In addition to scalability challenges, real world applications often require much more complex graph processing workflows than previously evalu- ated. In this paper, we describe the usability, performance, and scalability improvements we made to Apache Giraph, an open-source graph processing system, in order to use it on Facebook-scale graphs of up to one trillion edges. We also describe several key extensions to the original Pregel model that make it possible to develop a broader range of production graph applications and workflows as well as im- prove code reuse. Finally, we report on real-world operations as well as performance characteristics of several large-scale production applications.

## Facts

- Kind: [Paper](https://links.thingelstad.xyz/kinds/paper/)

## Saved the same week

- [Database encryption | OrientDB Manual - version 2.1](https://links.thingelstad.xyz/links/2fd722c65eb5/) (orientdb.com, August 21, 2015)
- [Foo Fighters’ Dave Grohl On His Emmy-Nominated Series ‘Sonic Highways’ | Deadline](https://links.thingelstad.xyz/links/023e6edd7003/) (deadline.com, August 21, 2015)
- [How to create waterfall chart in Excel 2010 - 2013](https://links.thingelstad.xyz/links/790ba9b5f60c/) (ablebits.com, August 21, 2015)
- [being PM from Nat Brown on Twitter](https://links.thingelstad.xyz/links/997ccd517a35/) (twitter.com, August 21, 2015)
- [Who’s still wearing cargo shorts?](https://links.thingelstad.xyz/links/f51e82ba45c2/) (joeydevilla.com, August 23, 2015)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/http://www.vldb.org/pvldb/vol8/p1804-ching.pdf