# What Are Transformer Models and How Do They Work?

<https://txt.cohere.ai/what-are-transformer-models/>

- Host: [txt.cohere.ai](https://links.thingelstad.xyz/hosts/txt.cohere.ai/)
- Saved: April 17, 2023 (2023-04-18T03:25:23Z)
- Record: https://links.thingelstad.xyz/links/e245924bfde5/
- JSON: https://links.thingelstad.xyz/links/e245924bfde5.json

## What Jamie wrote

Simplified overview of how a Transformer like GPT functions. I worry about overdoing the "one word at a time" heuristic that is commonly thrown out. I think it encourages oversimplification, but this does a good job of covering the various layers of the solutions.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT251: Weekly Thing #251 / Moloch, Chess, Protocol](https://weekly.thingelstad.com/archive/251/), Notable

## Saved the same week

- [I'm a Blogger - hutaffe.blog](https://links.thingelstad.xyz/links/71f4031d53ef/) (hutaffe.blog, April 17, 2023)
- [Prompt injection: What’s the worst that can happen?](https://links.thingelstad.xyz/links/8144e594e273/) (simonwillison.net, April 17, 2023)
- [U.S. Teen Girls Experiencing Increased Sadness and Violence | CDC](https://links.thingelstad.xyz/links/e125946cb691/) (cdc.gov, April 17, 2023)
- [What Is A Protocol And Why Does It Matter? - AVC](https://links.thingelstad.xyz/links/e9793fd3f19a/) (avc.com, April 17, 2023)
- [2023 State of Crypto Report: Introducing the State of Crypto Index - a16z crypto](https://links.thingelstad.xyz/links/5cd0c3d1da95/) (a16zcrypto.com, April 17, 2023)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://txt.cohere.ai/what-are-transformer-models/