Matches in SemOpenAlex for { <https://semopenalex.org/work/W2617800306> ?p ?o ?g. }
- W2617800306 abstract "There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a means for statistical inference on multinomial Bernoulli processes (Jaynes maximum entropy principle). Even though these notions are fundamentally different concepts, the functional form of the entropy for thermodynamic systems in equilibrium, for ergodic sources in information theory, and for independent sampling processes in statistical systems, is degenerate, $H(p)=-sum_i p_ilog p_i$. For many complex systems, which are typically history-dependent, non-ergodic and non-multinomial, this is no longer the case. Here we show that for such processes the three entropy concepts lead to different functional forms of entropy. We explicitly compute these entropy functionals for three concrete examples. For Polya urn processes, which are simple self-reinforcing processes, the source information rate is $S_{rm IT}=frac{1}{1-c}frac1N log N$, the thermodynamical (extensive) entropy is $(c,d)$-entropy, $S_{rm EXT}=S_{(c,0)}$, and the entropy in the maxent principle (MEP) is $S_{rm MEP}(p)=-sum_i log p_i$. For sample space reducing (SSR) processes, which are simple path-dependent processes that are associated with power law statistics, the information rate is $S_{rm IT}=1+ frac12 log W$, the extensive entropy is $S_{rm EXT}=H(p)$, and the maxent result is $S_{rm MEP}(p)=H(p/p_1)+H(1-p/p_1)$. Finally, for multinomial mixture processes, the information rate is given by the conditional entropy $langle Hrangle_f$, with respect to the mixing kernel $f$, the extensive entropy is given by $H$, and the MEP functional corresponds one-to-one to the logarithm of the mixing kernel." @default.
- W2617800306 created "2017-06-05" @default.
- W2617800306 creator A5019906371 @default.
- W2617800306 creator A5025590875 @default.
- W2617800306 creator A5045565551 @default.
- W2617800306 date "2017-09-15" @default.
- W2617800306 modified "2023-10-05" @default.
- W2617800306 title "Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle" @default.
- W2617800306 cites W1965555277 @default.
- W2617800306 cites W1968250327 @default.
- W2617800306 cites W1970091448 @default.
- W2617800306 cites W1976649818 @default.
- W2617800306 cites W1987794091 @default.
- W2617800306 cites W1995875735 @default.
- W2617800306 cites W2015170649 @default.
- W2617800306 cites W2025494293 @default.
- W2617800306 cites W2032558547 @default.
- W2617800306 cites W2047210381 @default.
- W2617800306 cites W2056215740 @default.
- W2617800306 cites W2084600505 @default.
- W2617800306 cites W2088048184 @default.
- W2617800306 cites W2093802314 @default.
- W2617800306 cites W2099111195 @default.
- W2617800306 cites W2141808451 @default.
- W2617800306 cites W2169476932 @default.
- W2617800306 cites W2282003050 @default.
- W2617800306 cites W2587924268 @default.
- W2617800306 cites W2964213744 @default.
- W2617800306 cites W3099678069 @default.
- W2617800306 doi "https://doi.org/10.1103/physreve.96.032124" @default.
- W2617800306 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/29346985" @default.
- W2617800306 hasPublicationYear "2017" @default.
- W2617800306 type Work @default.
- W2617800306 sameAs 2617800306 @default.
- W2617800306 citedByCount "27" @default.
- W2617800306 countsByYear W26178003062016 @default.
- W2617800306 countsByYear W26178003062018 @default.
- W2617800306 countsByYear W26178003062019 @default.
- W2617800306 countsByYear W26178003062020 @default.
- W2617800306 countsByYear W26178003062021 @default.
- W2617800306 countsByYear W26178003062022 @default.
- W2617800306 countsByYear W26178003062023 @default.
- W2617800306 crossrefType "journal-article" @default.
- W2617800306 hasAuthorship W2617800306A5019906371 @default.
- W2617800306 hasAuthorship W2617800306A5025590875 @default.
- W2617800306 hasAuthorship W2617800306A5045565551 @default.
- W2617800306 hasBestOaLocation W26178003062 @default.
- W2617800306 hasConcept C105795698 @default.
- W2617800306 hasConcept C106301342 @default.
- W2617800306 hasConcept C119820323 @default.
- W2617800306 hasConcept C121332964 @default.
- W2617800306 hasConcept C121864883 @default.
- W2617800306 hasConcept C122044880 @default.
- W2617800306 hasConcept C125252325 @default.
- W2617800306 hasConcept C134306372 @default.
- W2617800306 hasConcept C148563202 @default.
- W2617800306 hasConcept C165995430 @default.
- W2617800306 hasConcept C179434709 @default.
- W2617800306 hasConcept C33923547 @default.
- W2617800306 hasConcept C33932047 @default.
- W2617800306 hasConcept C42047476 @default.
- W2617800306 hasConcept C49775889 @default.
- W2617800306 hasConcept C60507348 @default.
- W2617800306 hasConcept C9679016 @default.
- W2617800306 hasConcept C97355855 @default.
- W2617800306 hasConceptScore W2617800306C105795698 @default.
- W2617800306 hasConceptScore W2617800306C106301342 @default.
- W2617800306 hasConceptScore W2617800306C119820323 @default.
- W2617800306 hasConceptScore W2617800306C121332964 @default.
- W2617800306 hasConceptScore W2617800306C121864883 @default.
- W2617800306 hasConceptScore W2617800306C122044880 @default.
- W2617800306 hasConceptScore W2617800306C125252325 @default.
- W2617800306 hasConceptScore W2617800306C134306372 @default.
- W2617800306 hasConceptScore W2617800306C148563202 @default.
- W2617800306 hasConceptScore W2617800306C165995430 @default.
- W2617800306 hasConceptScore W2617800306C179434709 @default.
- W2617800306 hasConceptScore W2617800306C33923547 @default.
- W2617800306 hasConceptScore W2617800306C33932047 @default.
- W2617800306 hasConceptScore W2617800306C42047476 @default.
- W2617800306 hasConceptScore W2617800306C49775889 @default.
- W2617800306 hasConceptScore W2617800306C60507348 @default.
- W2617800306 hasConceptScore W2617800306C9679016 @default.
- W2617800306 hasConceptScore W2617800306C97355855 @default.
- W2617800306 hasFunder F4320321181 @default.
- W2617800306 hasIssue "3" @default.
- W2617800306 hasLocation W26178003061 @default.
- W2617800306 hasLocation W26178003062 @default.
- W2617800306 hasLocation W26178003063 @default.
- W2617800306 hasOpenAccess W2617800306 @default.
- W2617800306 hasPrimaryLocation W26178003061 @default.
- W2617800306 hasRelatedWork W1519661313 @default.
- W2617800306 hasRelatedWork W1527265500 @default.
- W2617800306 hasRelatedWork W2012183338 @default.
- W2617800306 hasRelatedWork W2036400433 @default.
- W2617800306 hasRelatedWork W2089951711 @default.
- W2617800306 hasRelatedWork W2092814302 @default.
- W2617800306 hasRelatedWork W2772729974 @default.
- W2617800306 hasRelatedWork W2963955600 @default.
- W2617800306 hasRelatedWork W3098717111 @default.
- W2617800306 hasRelatedWork W3104925384 @default.