Matches in SemOpenAlex for { <https://semopenalex.org/work/W2134287462> ?p ?o ?g. }
- W2134287462 abstract "Statistical entropy was introduced by Shannon as a basic concept in information theory measuring the average missing information in a random source. Extended into an entropy rate, it gives bounds in coding and compression theorems. In this paper, I describe how statistical entropy and entropy rate relate to other notions of entropy that are relevant to probability theory (entropy of a discrete probability distribution measuring its unevenness), computer sciences (algorithmic complexity), the ergodic theory of dynamical systems (Kolmogorov–Sinai or metric entropy) and statistical physics (Boltzmann entropy). Their mathematical foundations and correlates (the entropy concentration, Sanov, Shannon–McMillan–Breiman, Lempel–Ziv and Pesin theorems) clarify their interpretation and offer a rigorous basis for maximum entropy principles. Although often ignored, these mathematical perspectives give a central position to entropy and relative entropy in statistical laws describing generic collective behaviours, and provide insights into the notions of randomness, typicality and disorder. The relevance of entropy beyond the realm of physics, in particular for living systems and ecosystems, is yet to be demonstrated." @default.
- W2134287462 created "2016-06-24" @default.
- W2134287462 creator A5068924391 @default.
- W2134287462 date "2014-03-28" @default.
- W2134287462 modified "2023-10-03" @default.
- W2134287462 title "Shannon entropy: a rigorous notion at the crossroads between probability, information theory, dynamical systems and statistical physics" @default.
- W2134287462 cites W123253449 @default.
- W2134287462 cites W1483888214 @default.
- W2134287462 cites W149658591 @default.
- W2134287462 cites W1538135945 @default.
- W2134287462 cites W1582868718 @default.
- W2134287462 cites W1615763157 @default.
- W2134287462 cites W1965202306 @default.
- W2134287462 cites W1965555277 @default.
- W2134287462 cites W1966767328 @default.
- W2134287462 cites W1968250327 @default.
- W2134287462 cites W1970091448 @default.
- W2134287462 cites W1972633005 @default.
- W2134287462 cites W1974109703 @default.
- W2134287462 cites W197497516 @default.
- W2134287462 cites W1980144689 @default.
- W2134287462 cites W1983282154 @default.
- W2134287462 cites W1984602147 @default.
- W2134287462 cites W1987073094 @default.
- W2134287462 cites W1992222799 @default.
- W2134287462 cites W1992649154 @default.
- W2134287462 cites W1993380370 @default.
- W2134287462 cites W1995875735 @default.
- W2134287462 cites W1999518678 @default.
- W2134287462 cites W2001768556 @default.
- W2134287462 cites W2001965680 @default.
- W2134287462 cites W2006624419 @default.
- W2134287462 cites W2007873004 @default.
- W2134287462 cites W2009502523 @default.
- W2134287462 cites W2010584937 @default.
- W2134287462 cites W2014504423 @default.
- W2134287462 cites W2018490621 @default.
- W2134287462 cites W2025130480 @default.
- W2134287462 cites W2025513587 @default.
- W2134287462 cites W2027321393 @default.
- W2134287462 cites W2031451638 @default.
- W2134287462 cites W2032558547 @default.
- W2134287462 cites W2033672007 @default.
- W2134287462 cites W2033686454 @default.
- W2134287462 cites W2036613247 @default.
- W2134287462 cites W2050976220 @default.
- W2134287462 cites W2053147468 @default.
- W2134287462 cites W2055281720 @default.
- W2134287462 cites W2058879612 @default.
- W2134287462 cites W2065557403 @default.
- W2134287462 cites W2067580807 @default.
- W2134287462 cites W2068588832 @default.
- W2134287462 cites W2076065057 @default.
- W2134287462 cites W2077770566 @default.
- W2134287462 cites W2083378218 @default.
- W2134287462 cites W2084379974 @default.
- W2134287462 cites W20854365 @default.
- W2134287462 cites W2086435517 @default.
- W2134287462 cites W2090547656 @default.
- W2134287462 cites W2103756638 @default.
- W2134287462 cites W2106752089 @default.
- W2134287462 cites W2107745473 @default.
- W2134287462 cites W2108947461 @default.
- W2134287462 cites W2111414208 @default.
- W2134287462 cites W2122962290 @default.
- W2134287462 cites W2123088883 @default.
- W2134287462 cites W2124625702 @default.
- W2134287462 cites W2134312352 @default.
- W2134287462 cites W2139416101 @default.
- W2134287462 cites W2146494856 @default.
- W2134287462 cites W2154462988 @default.
- W2134287462 cites W2160709761 @default.
- W2134287462 cites W2167536936 @default.
- W2134287462 cites W2190047654 @default.
- W2134287462 cites W2330702262 @default.
- W2134287462 cites W2489512873 @default.
- W2134287462 cites W3101604308 @default.
- W2134287462 cites W3150574340 @default.
- W2134287462 cites W4206655569 @default.
- W2134287462 cites W4230960895 @default.
- W2134287462 cites W4233798822 @default.
- W2134287462 cites W4234011050 @default.
- W2134287462 cites W4238049858 @default.
- W2134287462 cites W4244229143 @default.
- W2134287462 cites W4246303904 @default.
- W2134287462 cites W4251136000 @default.
- W2134287462 cites W4252028749 @default.
- W2134287462 cites W4255142739 @default.
- W2134287462 cites W4255933248 @default.
- W2134287462 cites W3144644885 @default.
- W2134287462 doi "https://doi.org/10.1017/s0960129512000783" @default.
- W2134287462 hasPublicationYear "2014" @default.
- W2134287462 type Work @default.
- W2134287462 sameAs 2134287462 @default.
- W2134287462 citedByCount "125" @default.
- W2134287462 countsByYear W21342874622014 @default.
- W2134287462 countsByYear W21342874622015 @default.
- W2134287462 countsByYear W21342874622016 @default.
- W2134287462 countsByYear W21342874622017 @default.
- W2134287462 countsByYear W21342874622018 @default.