Proceedings of the National Academy of Sciences, Volume 122, Issue 25, June 2025. <br/>SignificanceIn 1951, Claude Shannon, the father of information theory, estimated that the English language has a statistical redundancy of about 80%, by letting human subjects guess the next letter in an unfamiliar text. Today, large language models (LLMs)…
