Hallucination, monofacts, and miscalibration: An empirical investigation

Proceedings of the National Academy of Sciences, Volume 123, Number 8, February 2026.
Significance We show that hallucinations in large language models can be controlled through deliberate manipulation of the frequency distributions of the training data. By sampling training data from heavy-tailed distributions that naturally reduce rare facts, and…