Shane Chu

Why LLMs suck at giving life advices

We live in a world where the things we tend to care about most – wealth, fame, and similar achievements – follow power-law distributions. The good news is that extreme outcomes are common and easy to spot. The bad news is that reaching these status typically requires substantial effort and resources. Why? Supply and demand. When actionable knowledge becomes widely known, everyone tries to exploit it at some point. The resulting competition dilutes the potential gains across many actors, making it harder for any single person to capture outsized returns. This dynamic is most vivid in the stock market, where insider trading, initial knowledge gaps, and asymmetric information determine who can achieve exceptional results with less effort.

What makes LLMs particularly limited for life advice is that their responses, by default, occupy a semantic space that tends toward normal distribution (just think CLT) for a given prompt. What's more valuable is the borderline controversial, counter-intuitive, well-guarded insight likely lives in the tailed ends of the response distribution, if it exists in the LLM's semantic space at all. In a certain sense, accessing these insights is like escaping a local minimum: the crudest method is through noise, but more sophisticated approaches resemble what Taleb might describe – deliberately seeking out good filters, e.g. experienced practitioners who have been tinkering long enough to know what doesn't work.

In many areas of science and technology, however, LLMs prove valuableas knowledge that was once expensive is now cheap, and learning, while not universally barrier-free, has become dramatically more accessible in many domains. Routine boilerplate tasks like unit tests and memory management in software development, which bear little relation to the original problem, can now be automated. Readers gain unprecedented control over the pace at which they engage with technically dense papers. Here, we interpolate our knowledge gaps, compensating for the bottleneck of absorbing and utilizing knowledge.

Contact me by E-mail | Github | Linkedin
This work is licensed under CC BY-SA 4.0. Last modified: October 23, 2025.
Website built with Franklin.jl and the Julia language.