Embeddings: What they are and why they matter

Good overview from Willison introducing Embeddings and going into some detail on how to use them.

Embeddings are a technology that’s adjacent to the wider field of Large Language Models—the technology behind ChatGPT and Bard and Claude.

Embeddings are based around one trick: take a piece of content—in this case a blog entry—and turn that piece of content into an array of floating point numbers.

He goes through a couple of examples and gives command line information so you can follow along.