{
  "id": "1a916f5a8bf3",
  "url": "https://lethain.com/mental-model-for-how-to-use-llms-in-products/",
  "title": "Notes on how to use LLMs in your product. | Irrational Exuberance",
  "note": "Will Larson shares his \"notes\" as he has been working on adding LLM capabilities to products. There are some really good thoughts here that should help product people figure out how to approach this and result in better outcomes. \n\nSome highlights I pulled out… \n\n> My belief is that many existing products will find they can only significantly benefit their user experience from LLMs by rethinking their workflows.\n\n> This makes a lot of sense, and the two phase combination of an unsophisticated algorithm to get plausible components of a response along with an LLM to filter through and package the plausible responses into an actual response works pretty well.\n\n> Because you cannot rely on LLMs to provide correct responses, and you cannot generate a confidence score for any given response, you have to either accept potential inaccuracies (which makes sense in many cases, humans are wrong sometimes too) or keep a Human-in-the-Loop (HITL) to validate the response.\n\n> Every large-scale adoption of LLMs today is being done in a mode where it shifts responsibility for the responses to a participating human.\n\nNot a single line in this that I would disagree with. Great stuff. ",
  "voice": "mixed",
  "saved": "2024-04-12T00:19:02Z",
  "host": "lethain.com",
  "kind": "page",
  "tags": [],
  "record": "https://links.thingelstad.xyz/links/1a916f5a8bf3/",
  "markdown": "https://links.thingelstad.xyz/links/1a916f5a8bf3.md",
  "issues": [
    {
      "number": 283,
      "slug": "283",
      "title": "Weekly Thing 283 / Betula, Blocky, Tables",
      "date": "2024-04-13T12:00:00Z",
      "section": "Notable",
      "position": 4,
      "url": "https://weekly.thingelstad.com/archive/283/",
      "page": "https://links.thingelstad.xyz/issues/283/"
    }
  ],
  "connections": {
    "same_host": {
      "count": 44,
      "page": "https://links.thingelstad.xyz/hosts/lethain.com/",
      "nearest": [
        {
          "id": "5c40bb245f42",
          "title": "The Engineering executive’s role in hiring. | Irrational Exuberance",
          "url": "https://lethain.com/eng-exec-role-in-hiring/",
          "record": "https://links.thingelstad.xyz/links/5c40bb245f42/"
        },
        {
          "id": "6aaa5b819e50",
          "title": "Notes on Enterprise Architecture as Strategy | Irrational Exuberance",
          "url": "https://lethain.com/notes-on-enterprise-architecture-as-strategy/",
          "record": "https://links.thingelstad.xyz/links/6aaa5b819e50/"
        },
        {
          "id": "1969ce23a16c",
          "title": "Predictability. | Irrational Exuberance",
          "url": "https://lethain.com/predictability/",
          "record": "https://links.thingelstad.xyz/links/1969ce23a16c/"
        },
        {
          "id": "23efc27942e1",
          "title": "No Wrong Doors | Irrational Exuberance",
          "url": "https://lethain.com/no-wrong-doors/",
          "record": "https://links.thingelstad.xyz/links/23efc27942e1/"
        },
        {
          "id": "58e7ea0d6242",
          "title": "2024 in review. | Irrational Exuberance",
          "url": "https://lethain.com/2024-in-review/",
          "record": "https://links.thingelstad.xyz/links/58e7ea0d6242/"
        }
      ]
    },
    "same_week": {
      "count": 22,
      "nearest": [
        {
          "id": "59025b125f3c",
          "title": "How Engineers at Digital Equipment Corp. Saved Ethernet - IEEE Spectrum",
          "url": "https://spectrum.ieee.org/how-dec-engineers-saved-ethernet",
          "record": "https://links.thingelstad.xyz/links/59025b125f3c/"
        },
        {
          "id": "a678f41857b7",
          "title": "oisd | domain blocklist",
          "url": "https://oisd.nl/",
          "record": "https://links.thingelstad.xyz/links/a678f41857b7/"
        },
        {
          "id": "d816205d3888",
          "title": "Twitter’s Clumsy Pivot to X.com Is a Gift to Phishers – Krebs on Security",
          "url": "https://krebsonsecurity.com/2024/04/twitters-clumsy-pivot-to-x-com-is-a-gift-to-phishers/",
          "record": "https://links.thingelstad.xyz/links/d816205d3888/"
        },
        {
          "id": "f223e6554981",
          "title": "The Best Photos and Videos of the 2024 Solar Eclipse",
          "url": "https://kottke.org/24/04/the-best-photos-and-videos-of-the-2024-solar-eclipse",
          "record": "https://links.thingelstad.xyz/links/f223e6554981/"
        },
        {
          "id": "74311c67d1c6",
          "title": "Platformonomics - Follow the CAPEX: The Clown Car Race Checkered Flag",
          "url": "https://platformonomics.com/2024/04/follow-the-capex-the-clown-car-race-checkered-flag/",
          "record": "https://links.thingelstad.xyz/links/74311c67d1c6/"
        }
      ]
    },
    "mentions": [],
    "mentioned_by": [],
    "saved_twice": []
  },
  "elsewhere": {
    "wayback": "https://web.archive.org/web/*/https://lethain.com/mental-model-for-how-to-use-llms-in-products/"
  }
}