# Lessons after a half-billion GPT tokens - Ken Kantzer's Blog

<https://kenkantzer.com/lessons-after-a-half-billion-gpt-tokens/>

- Host: [kenkantzer.com](https://links.thingelstad.xyz/hosts/kenkantzer.com/)
- Saved: April 14, 2024 (2024-04-15T00:59:17Z)
- Record: https://links.thingelstad.xyz/links/f15b9306ec21/
- JSON: https://links.thingelstad.xyz/links/f15b9306ec21.json

## What Jamie wrote

Kantzer shares some key observations from his work building functionality with LLMs. 

> 1. When it comes to prompts, less is more.
> 2. You don’t need langchain. You probably don’t even need anything else OpenAI has released in their API in the last year. Just chat API. That’s it.
> 3. Improving the latency with streaming API and showing users variable-speed typed words is actually a big UX innovation with ChatGPT.
> 4. GPT is really bad at producing the null hypothesis.
> 5. “Context windows” are a misnomer – and they are only growing larger for input, not output.
> 6. Vector databases, and RAG/embeddings are mostly useless for us mere mortals.
> 7. Hallucination basically doesn’t happen.

He goes into details on each of these points. There is some good learnings here.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT284: Weekly Thing 284 / Playdate, Tetris, Calvin](https://weekly.thingelstad.com/archive/284/), Notable

## Saved the same week

- [The UX of UUIDs | Unkey](https://links.thingelstad.xyz/links/399bf3e91b56/) (unkey.dev, April 14, 2024)
- [Peloton is a media company now, with media company problems](https://links.thingelstad.xyz/links/1ba7e337e510/) (theverge.com, April 14, 2024)
- [Kaspersky analysis of the backdoor in XZ | Securelist](https://links.thingelstad.xyz/links/85ff6c3119ce/) (securelist.com, April 14, 2024)
- [Privacy Pro: DuckDuckGo's New 3-in-1 Subscription Service](https://links.thingelstad.xyz/links/84bbeaffe8cb/) (spreadprivacy.com, April 14, 2024)
- [What makes a great technical blog | notes.eatonphil.com](https://links.thingelstad.xyz/links/e2c42df04ef1/) (notes.eatonphil.com, April 14, 2024)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://kenkantzer.com/lessons-after-a-half-billion-gpt-tokens/