# An update on Sunday’s service disruption | Google Cloud Blog

<https://cloud.google.com/blog/topics/inside-google-cloud/an-update-on-sundays-service-disruption>

- Host: [cloud.google.com](https://links.thingelstad.xyz/hosts/cloud.google.com/)
- Saved: June 6, 2019 (2019-06-06T11:08:37Z)
- Record: https://links.thingelstad.xyz/links/fe34ae120edd/
- JSON: https://links.thingelstad.xyz/links/fe34ae120edd.json

## What Jamie wrote

When the biggest cloud providers in the world have issues it’s a good reminder on how hard it is to run technology platforms, at scale, continuously. 

> In essence, the root cause of Sunday’s disruption was a configuration change that was intended for a small number of servers in a single region. The configuration was incorrectly applied to a larger number of servers across several neighboring regions, and it caused those regions to stop using more than half of their available network capacity.

Sounds similar to other big outages, unintended consequences of a change or accidental scoping of a change. These changes come from expert administrators, so the machines follow the direction. I don't think it'll be that long before we build some skepticism into our platforms to not always trust even an expert administrators direction if the scope of that change is large.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT109: Weekly Thing #109 / Jun 8, 2019](https://weekly.thingelstad.com/archive/109/), Notable Links 📌

## Same host

- [Knative - Built on Kubernetes and Istio  |  Google Cloud](https://links.thingelstad.xyz/links/d051ff8d2d93/) (cloud.google.com, July 26, 2018)
- [API design: Why you should use links, not keys, to represent relationships in APIs | Google Cloud Blog](https://links.thingelstad.xyz/links/7de3968bed39/) (cloud.google.com, May 14, 2019)
- [Announcing Snowflake on Google Cloud Platform | Google Cloud Blog](https://links.thingelstad.xyz/links/c08ba2d33469/) (cloud.google.com, June 4, 2019)
- [Women in leadership: Why Diversity, Equity and Inclusion matters at Google Cloud | Google Cloud Blog](https://links.thingelstad.xyz/links/df59247aa0d1/) (cloud.google.com, March 11, 2021)
- [Retailers unwrap a successful 2021 holiday season with Google’s Black Friday/Cyber Monday program](https://links.thingelstad.xyz/links/ad84f7e4cf8a/) (cloud.google.com, January 25, 2022)

## Saved the same week

- [Shopify Unveils First State of Commerce Report - MarketWatch](https://links.thingelstad.xyz/links/00cb991e5410/) (marketwatch.com, June 6, 2019)
- [The Full List of Automation Triggers in Shortcuts for iOS 13 – MacStories](https://links.thingelstad.xyz/links/6eb30ad84b47/) (macstories.net, June 6, 2019)
- [Apple’s Audacity – Stratechery by Ben Thompson](https://links.thingelstad.xyz/links/a8d77d1c930d/) (stratechery.com, June 6, 2019)
- [How Cooking Can Change Your Life - Michael Pollan - YouTube](https://links.thingelstad.xyz/links/30d48231e849/) (youtube.com, June 6, 2019)
- [How to Organize Your Life With GTD (Step-By-Step Workflow Guide)](https://links.thingelstad.xyz/links/d8c0fb76f105/) (doist.com, June 6, 2019)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://cloud.google.com/blog/topics/inside-google-cloud/an-update-on-sundays-service-disruption