{
  "id": "f15b9306ec21",
  "url": "https://kenkantzer.com/lessons-after-a-half-billion-gpt-tokens/",
  "title": "Lessons after a half-billion GPT tokens - Ken Kantzer's Blog",
  "note": "Kantzer shares some key observations from his work building functionality with LLMs. \n\n> 1. When it comes to prompts, less is more.\n> 2. You don’t need langchain. You probably don’t even need anything else OpenAI has released in their API in the last year. Just chat API. That’s it.\n> 3. Improving the latency with streaming API and showing users variable-speed typed words is actually a big UX innovation with ChatGPT.\n> 4. GPT is really bad at producing the null hypothesis.\n> 5. “Context windows” are a misnomer – and they are only growing larger for input, not output.\n> 6. Vector databases, and RAG/embeddings are mostly useless for us mere mortals.\n> 7. Hallucination basically doesn’t happen.\n\nHe goes into details on each of these points. There is some good learnings here. ",
  "voice": "mixed",
  "saved": "2024-04-15T00:59:17Z",
  "host": "kenkantzer.com",
  "kind": "page",
  "tags": [],
  "record": "https://links.thingelstad.xyz/links/f15b9306ec21/",
  "markdown": "https://links.thingelstad.xyz/links/f15b9306ec21.md",
  "issues": [
    {
      "number": 284,
      "slug": "284",
      "title": "Weekly Thing 284 / Playdate, Tetris, Calvin",
      "date": "2024-04-20T12:00:00Z",
      "section": "Notable",
      "position": 2,
      "url": "https://weekly.thingelstad.com/archive/284/",
      "page": "https://links.thingelstad.xyz/issues/284/"
    }
  ],
  "connections": {
    "same_host": {
      "count": 0,
      "page": "https://links.thingelstad.xyz/hosts/kenkantzer.com/",
      "nearest": []
    },
    "same_week": {
      "count": 22,
      "nearest": [
        {
          "id": "399bf3e91b56",
          "title": "The UX of UUIDs | Unkey",
          "url": "https://unkey.dev/blog/uuid-ux",
          "record": "https://links.thingelstad.xyz/links/399bf3e91b56/"
        },
        {
          "id": "1ba7e337e510",
          "title": "Peloton is a media company now, with media company problems",
          "url": "https://www.theverge.com/c/24105625/peloton-bike-tread-plus-business-valuation-history",
          "record": "https://links.thingelstad.xyz/links/1ba7e337e510/"
        },
        {
          "id": "85ff6c3119ce",
          "title": "Kaspersky analysis of the backdoor in XZ | Securelist",
          "url": "https://securelist.com/xz-backdoor-story-part-1/112354/",
          "record": "https://links.thingelstad.xyz/links/85ff6c3119ce/"
        },
        {
          "id": "84bbeaffe8cb",
          "title": "Privacy Pro: DuckDuckGo's New 3-in-1 Subscription Service",
          "url": "https://spreadprivacy.com/meetprivacypro/",
          "record": "https://links.thingelstad.xyz/links/84bbeaffe8cb/"
        },
        {
          "id": "e2c42df04ef1",
          "title": "What makes a great technical blog | notes.eatonphil.com",
          "url": "https://notes.eatonphil.com/2024-04-10-what-makes-a-great-tech-blog.html",
          "record": "https://links.thingelstad.xyz/links/e2c42df04ef1/"
        }
      ]
    },
    "mentions": [],
    "mentioned_by": [],
    "saved_twice": []
  },
  "elsewhere": {
    "wayback": "https://web.archive.org/web/*/https://kenkantzer.com/lessons-after-a-half-billion-gpt-tokens/"
  }
}