# Notes on how to use LLMs in your product. | Irrational Exuberance

<https://lethain.com/mental-model-for-how-to-use-llms-in-products/>

- Host: [lethain.com](https://links.thingelstad.xyz/hosts/lethain.com/)
- Saved: April 11, 2024 (2024-04-12T00:19:02Z)
- Record: https://links.thingelstad.xyz/links/1a916f5a8bf3/
- JSON: https://links.thingelstad.xyz/links/1a916f5a8bf3.json

## What Jamie wrote

Will Larson shares his "notes" as he has been working on adding LLM capabilities to products. There are some really good thoughts here that should help product people figure out how to approach this and result in better outcomes. 

Some highlights I pulled out… 

> My belief is that many existing products will find they can only significantly benefit their user experience from LLMs by rethinking their workflows.

> This makes a lot of sense, and the two phase combination of an unsophisticated algorithm to get plausible components of a response along with an LLM to filter through and package the plausible responses into an actual response works pretty well.

> Because you cannot rely on LLMs to provide correct responses, and you cannot generate a confidence score for any given response, you have to either accept potential inaccuracies (which makes sense in many cases, humans are wrong sometimes too) or keep a Human-in-the-Loop (HITL) to validate the response.

> Every large-scale adoption of LLMs today is being done in a mode where it shifts responsibility for the responses to a participating human.

Not a single line in this that I would disagree with. Great stuff.

## Facts

- Kind: [Page](https://links.thingelstad.xyz/kinds/page/)

## Appears in

- [WT283: Weekly Thing 283 / Betula, Blocky, Tables](https://weekly.thingelstad.com/archive/283/), Notable

## Same host

- [The Engineering executive’s role in hiring. | Irrational Exuberance](https://links.thingelstad.xyz/links/5c40bb245f42/) (lethain.com, September 4, 2023)
- [Notes on Enterprise Architecture as Strategy | Irrational Exuberance](https://links.thingelstad.xyz/links/6aaa5b819e50/) (lethain.com, December 11, 2023)
- [Predictability. | Irrational Exuberance](https://links.thingelstad.xyz/links/1969ce23a16c/) (lethain.com, January 4, 2024)
- [No Wrong Doors | Irrational Exuberance](https://links.thingelstad.xyz/links/23efc27942e1/) (lethain.com, May 23, 2024)
- [2024 in review. | Irrational Exuberance](https://links.thingelstad.xyz/links/58e7ea0d6242/) (lethain.com, December 20, 2024)

## Saved the same week

- [How Engineers at Digital Equipment Corp. Saved Ethernet - IEEE Spectrum](https://links.thingelstad.xyz/links/59025b125f3c/) (spectrum.ieee.org, April 11, 2024)
- [oisd | domain blocklist](https://links.thingelstad.xyz/links/a678f41857b7/) (oisd.nl, April 11, 2024)
- [Twitter’s Clumsy Pivot to X.com Is a Gift to Phishers – Krebs on Security](https://links.thingelstad.xyz/links/d816205d3888/) (krebsonsecurity.com, April 11, 2024)
- [The Best Photos and Videos of the 2024 Solar Eclipse](https://links.thingelstad.xyz/links/f223e6554981/) (kottke.org, April 11, 2024)
- [Platformonomics - Follow the CAPEX: The Clown Car Race Checkered Flag](https://links.thingelstad.xyz/links/74311c67d1c6/) (platformonomics.com, April 11, 2024)

## Elsewhere

- Wayback Machine: https://web.archive.org/web/*/https://lethain.com/mental-model-for-how-to-use-llms-in-products/