Open Access
Research Article·pp. 3143–3151·Vol. 47, Issue 9-ASep 2026
Entropy evolution in multilingual transformer models : An information-theoretic perspective
Arti Bansode, Anita Chaware
Published Online: 30 Sep 2026DOI: 10.47974/JIOS-2353
In this paper: Entropy is used to quantify uncertainty in probabilistic representations. Hence, studying how uncertainty evolves across layers in LLMs can help us understand how these models process different langua...
