All the Hard Stuff Nobody Talks About when Building Products with LLMs | Honeycomb

Good set of challenges enumerated by the Honeycomb team trying to use an LLM to generate the complicated input into their query engine. I found this call out particularly worth remembering:

Unless you’re literally in the business of selling LLMs, an LLM isn’t a product! It’s an engine for features.

Don't start with the LLM, start with the problem you are solving for your user.