Matches in SemOpenAlex for { <https://semopenalex.org/work/W3104105596> ?p ?o ?g. }
- W3104105596 endingPage "10728" @default.
- W3104105596 startingPage "10718" @default.
- W3104105596 abstract "Implicit-depth models such as Deep Equilibrium Networks have recently been shown to match or exceed the performance of traditional deep networks while being much more memory efficient. However, these models suffer from unstable convergence to a solution and lack guarantees that a solution exists. On the other hand, Neural ODEs, another class of implicit-depth models, do guarantee existence of a unique solution but perform poorly compared with traditional networks. In this paper, we develop a new class of implicit-depth model based on the theory of monotone operators, the Monotone Operator Equilibrium Network (MON). We show the close connection between finding the equilibrium point of an implicit network and solving a form of monotone operator splitting problem, which admits efficient solvers with guaranteed, stable convergence. We then develop a parameterization of the network which ensures that all operators remain monotone, which guarantees the existence of a unique equilibrium point. Finally, we show how to instantiate several versions of these models, and implement the resulting iterative solvers, for structured linear operators such as multi-scale convolutions. The resulting models vastly outperform the Neural ODE-based models while also being more computationally efficient. Code is available at this http URL." @default.
- W3104105596 created "2020-11-23" @default.
- W3104105596 creator A5037951424 @default.
- W3104105596 creator A5075035644 @default.
- W3104105596 date "2020-06-15" @default.
- W3104105596 modified "2023-09-24" @default.
- W3104105596 title "Monotone operator equilibrium networks." @default.
- W3104105596 hasPublicationYear "2020" @default.
- W3104105596 type Work @default.
- W3104105596 sameAs 3104105596 @default.
- W3104105596 citedByCount "11" @default.
- W3104105596 countsByYear W31041055962021 @default.
- W3104105596 countsByYear W31041055962022 @default.
- W3104105596 countsByYear W31041055962023 @default.
- W3104105596 crossrefType "proceedings-article" @default.
- W3104105596 hasAuthorship W3104105596A5037951424 @default.
- W3104105596 hasAuthorship W3104105596A5075035644 @default.
- W3104105596 hasConcept C104317684 @default.
- W3104105596 hasConcept C11413529 @default.
- W3104105596 hasConcept C118615104 @default.
- W3104105596 hasConcept C126255220 @default.
- W3104105596 hasConcept C132954091 @default.
- W3104105596 hasConcept C13355873 @default.
- W3104105596 hasConcept C134306372 @default.
- W3104105596 hasConcept C154945302 @default.
- W3104105596 hasConcept C158448853 @default.
- W3104105596 hasConcept C162324750 @default.
- W3104105596 hasConcept C17020691 @default.
- W3104105596 hasConcept C176691602 @default.
- W3104105596 hasConcept C185592680 @default.
- W3104105596 hasConcept C201040074 @default.
- W3104105596 hasConcept C2524010 @default.
- W3104105596 hasConcept C2777212361 @default.
- W3104105596 hasConcept C2777303404 @default.
- W3104105596 hasConcept C2834757 @default.
- W3104105596 hasConcept C28826006 @default.
- W3104105596 hasConcept C33923547 @default.
- W3104105596 hasConcept C34862557 @default.
- W3104105596 hasConcept C41008148 @default.
- W3104105596 hasConcept C50522688 @default.
- W3104105596 hasConcept C50644808 @default.
- W3104105596 hasConcept C55493867 @default.
- W3104105596 hasConcept C78045399 @default.
- W3104105596 hasConcept C80444323 @default.
- W3104105596 hasConcept C86339819 @default.
- W3104105596 hasConcept C94766913 @default.
- W3104105596 hasConcept C99392333 @default.
- W3104105596 hasConceptScore W3104105596C104317684 @default.
- W3104105596 hasConceptScore W3104105596C11413529 @default.
- W3104105596 hasConceptScore W3104105596C118615104 @default.
- W3104105596 hasConceptScore W3104105596C126255220 @default.
- W3104105596 hasConceptScore W3104105596C132954091 @default.
- W3104105596 hasConceptScore W3104105596C13355873 @default.
- W3104105596 hasConceptScore W3104105596C134306372 @default.
- W3104105596 hasConceptScore W3104105596C154945302 @default.
- W3104105596 hasConceptScore W3104105596C158448853 @default.
- W3104105596 hasConceptScore W3104105596C162324750 @default.
- W3104105596 hasConceptScore W3104105596C17020691 @default.
- W3104105596 hasConceptScore W3104105596C176691602 @default.
- W3104105596 hasConceptScore W3104105596C185592680 @default.
- W3104105596 hasConceptScore W3104105596C201040074 @default.
- W3104105596 hasConceptScore W3104105596C2524010 @default.
- W3104105596 hasConceptScore W3104105596C2777212361 @default.
- W3104105596 hasConceptScore W3104105596C2777303404 @default.
- W3104105596 hasConceptScore W3104105596C2834757 @default.
- W3104105596 hasConceptScore W3104105596C28826006 @default.
- W3104105596 hasConceptScore W3104105596C33923547 @default.
- W3104105596 hasConceptScore W3104105596C34862557 @default.
- W3104105596 hasConceptScore W3104105596C41008148 @default.
- W3104105596 hasConceptScore W3104105596C50522688 @default.
- W3104105596 hasConceptScore W3104105596C50644808 @default.
- W3104105596 hasConceptScore W3104105596C55493867 @default.
- W3104105596 hasConceptScore W3104105596C78045399 @default.
- W3104105596 hasConceptScore W3104105596C80444323 @default.
- W3104105596 hasConceptScore W3104105596C86339819 @default.
- W3104105596 hasConceptScore W3104105596C94766913 @default.
- W3104105596 hasConceptScore W3104105596C99392333 @default.
- W3104105596 hasLocation W31041055961 @default.
- W3104105596 hasOpenAccess W3104105596 @default.
- W3104105596 hasPrimaryLocation W31041055961 @default.
- W3104105596 hasRelatedWork W1758545165 @default.
- W3104105596 hasRelatedWork W2226102612 @default.
- W3104105596 hasRelatedWork W2909951968 @default.
- W3104105596 hasRelatedWork W2952070945 @default.
- W3104105596 hasRelatedWork W2963357609 @default.
- W3104105596 hasRelatedWork W2963755523 @default.
- W3104105596 hasRelatedWork W2963970238 @default.
- W3104105596 hasRelatedWork W2964121744 @default.
- W3104105596 hasRelatedWork W2965291189 @default.
- W3104105596 hasRelatedWork W2968953580 @default.
- W3104105596 hasRelatedWork W2969951231 @default.
- W3104105596 hasRelatedWork W2970900903 @default.
- W3104105596 hasRelatedWork W3009884173 @default.
- W3104105596 hasRelatedWork W3035194405 @default.
- W3104105596 hasRelatedWork W3098967720 @default.
- W3104105596 hasRelatedWork W3102760497 @default.
- W3104105596 hasRelatedWork W3111700986 @default.
- W3104105596 hasRelatedWork W3118608800 @default.