Understand the tech
Last updated
Last updated
Assumed audience: You’re a product manager working on an LLM powered feature. You’re familiar with how LLMs work. Use this as a starting point to think about the problems that LLMs are best suited to solve, and to start experimenting with these solutions.
Large Language Models provide a way for computers to understand natural human language and respond meaningfully. This was not possible prior to 2022.
Think of LLMs as small reasoning engines rather than as a magical black box to throw stuff into. The small reasoning engine approach makes it reliable, reduce hallucinations and reduce cost of operation as well.
Try not to misuse the LLM - like don’t answer someone’s birthday using an LLM just because you can. Using an LLM for it is less reliable and more expensive than querying a database.
