Entropy per word can be calculated precisely using information theory and semantics
Is it true that entropy per word can be calculated precisely using information theory and semantics?
Yes. Recent developments in semantic information theory successfully formalize how entropy can be extended and calculated in relation to word meanings and semantic content.
Verdict: SUPPORTED · 4 sources for, 0 against · Last checked
The claim states that entropy per word can be calculated precisely using information theory and semantics. Several retrieved papers (such as [3], [4], [5], and [6]) specifically develop semantic information theories that generalize classical Shannon entropy to quantify semantic information, meaning, and semantic entropy. These sources support the claim directly and there are no papers refuting the possibility of calculating semantic entropy.
Get citation
Saz, A. F., Xiong, S., Saidutta, Y. M., & Fekri, F. (2024). On the Theory of Semantic Information and Communication for Logical Inference. doi.org. https://doi.org/10.1109/WCNC65185.2026.11555338
See more details
Get citation
Lu, C. (2025). A Semantic Generalization of Shannon’s Information Theory and Applications. doi.org. https://doi.org/10.3390/e27050461
Get citation
Zhang, P., Niu, K., Liang, Z., Wang, C., Wu, J., Liu, Y., Xu, W., Ma, N., Xu, X., & Zhang, R. (2026). Beyond Shannon: Semantic Information Theory and Methodology. doi.org. https://doi.org/10.1109/TNSE.2026.3676901
Get citation
Tetlow, P., Garg, D., Chase, L., Mattingley-Scott, M., Bronn, N., Naidoo, K., & Reinert, E. (2022). Towards a Semantic Information Theory (Introducing Quantum Corollas)..
- Is it true that sentence information content is measured using information theory and entropy? SUPPORTED
- Is it true that the stem of a word carries the semantic information of its inflections? REFUTED
- Is it true that phase change entropy can be calculated using vaporization enthalpy and boiling point? SUPPORTED
What does the evidence say?
The claim states that entropy per word can be calculated precisely using information theory and semantics. Several retrieved papers (such as [3], [4], [5], and [6]) specifically develop semantic information theories that generalize classical Shannon entropy to quantify semantic information, meaning, and semantic entropy. These sources support the claim directly and there are no papers refuting the possibility of calculating semantic entropy.
Receipt History
Challenge the receipt
Citation formatting by citeproc-js (Frank Bennett) and the Citation Style Language project. Source and licenses.
Terms · Privacy · How verdicts work