Matches in SemOpenAlex for { <https://semopenalex.org/work/W2963992014> ?p ?o ?g. }
- W2963992014 endingPage "2409" @default.
- W2963992014 startingPage "2401" @default.
- W2963992014 abstract "The problem of learning long-term dependencies in sequences using Recurrent Neural Networks (RNNs) is still a major challenge. Recent methods have been suggested to solve this problem by constraining the transition matrix to be unitary during training which ensures that its norm is equal to one and prevents exploding gradients. These methods either have limited expressiveness or scale poorly with the size of the network when compared with the simple RNN case, especially when using stochastic gradient descent with a small mini-batch size. Our contributions are as follows; we first show that constraining the transition matrix to be unitary is a special case of an orthogonal constraint. Then we present a new parametrisation of the transition matrix which allows efficient training of an RNN while ensuring that the matrix is always orthogonal. Our results show that the orthogonal constraint on the transition matrix applied through our parametrisation gives similar benefits to the unitary constraint, without the time complexity limitations." @default.
- W2963992014 created "2019-07-30" @default.
- W2963992014 creator A5000151716 @default.
- W2963992014 creator A5031013029 @default.
- W2963992014 creator A5033128676 @default.
- W2963992014 creator A5033538273 @default.
- W2963992014 date "2017-07-17" @default.
- W2963992014 modified "2023-10-06" @default.
- W2963992014 title "Efficient orthogonal parametrisation of recurrent neural networks using householder reflections" @default.
- W2963992014 hasPublicationYear "2017" @default.
- W2963992014 type Work @default.
- W2963992014 sameAs 2963992014 @default.
- W2963992014 citedByCount "44" @default.
- W2963992014 countsByYear W29639920142017 @default.
- W2963992014 countsByYear W29639920142018 @default.
- W2963992014 countsByYear W29639920142019 @default.
- W2963992014 countsByYear W29639920142020 @default.
- W2963992014 countsByYear W29639920142021 @default.
- W2963992014 countsByYear W29639920142022 @default.
- W2963992014 crossrefType "proceedings-article" @default.
- W2963992014 hasAuthorship W2963992014A5000151716 @default.
- W2963992014 hasAuthorship W2963992014A5031013029 @default.
- W2963992014 hasAuthorship W2963992014A5033128676 @default.
- W2963992014 hasAuthorship W2963992014A5033538273 @default.
- W2963992014 hasConcept C106487976 @default.
- W2963992014 hasConcept C11413529 @default.
- W2963992014 hasConcept C119857082 @default.
- W2963992014 hasConcept C121332964 @default.
- W2963992014 hasConcept C126255220 @default.
- W2963992014 hasConcept C147168706 @default.
- W2963992014 hasConcept C153258448 @default.
- W2963992014 hasConcept C154945302 @default.
- W2963992014 hasConcept C158693339 @default.
- W2963992014 hasConcept C159985019 @default.
- W2963992014 hasConcept C17744445 @default.
- W2963992014 hasConcept C187064257 @default.
- W2963992014 hasConcept C191795146 @default.
- W2963992014 hasConcept C192562407 @default.
- W2963992014 hasConcept C199539241 @default.
- W2963992014 hasConcept C206688291 @default.
- W2963992014 hasConcept C22629506 @default.
- W2963992014 hasConcept C2524010 @default.
- W2963992014 hasConcept C2776036281 @default.
- W2963992014 hasConcept C28826006 @default.
- W2963992014 hasConcept C33923547 @default.
- W2963992014 hasConcept C41008148 @default.
- W2963992014 hasConcept C44292817 @default.
- W2963992014 hasConcept C49555168 @default.
- W2963992014 hasConcept C50644808 @default.
- W2963992014 hasConcept C54848796 @default.
- W2963992014 hasConcept C62520636 @default.
- W2963992014 hasConcept C67820243 @default.
- W2963992014 hasConcept C92207270 @default.
- W2963992014 hasConcept C98763669 @default.
- W2963992014 hasConceptScore W2963992014C106487976 @default.
- W2963992014 hasConceptScore W2963992014C11413529 @default.
- W2963992014 hasConceptScore W2963992014C119857082 @default.
- W2963992014 hasConceptScore W2963992014C121332964 @default.
- W2963992014 hasConceptScore W2963992014C126255220 @default.
- W2963992014 hasConceptScore W2963992014C147168706 @default.
- W2963992014 hasConceptScore W2963992014C153258448 @default.
- W2963992014 hasConceptScore W2963992014C154945302 @default.
- W2963992014 hasConceptScore W2963992014C158693339 @default.
- W2963992014 hasConceptScore W2963992014C159985019 @default.
- W2963992014 hasConceptScore W2963992014C17744445 @default.
- W2963992014 hasConceptScore W2963992014C187064257 @default.
- W2963992014 hasConceptScore W2963992014C191795146 @default.
- W2963992014 hasConceptScore W2963992014C192562407 @default.
- W2963992014 hasConceptScore W2963992014C199539241 @default.
- W2963992014 hasConceptScore W2963992014C206688291 @default.
- W2963992014 hasConceptScore W2963992014C22629506 @default.
- W2963992014 hasConceptScore W2963992014C2524010 @default.
- W2963992014 hasConceptScore W2963992014C2776036281 @default.
- W2963992014 hasConceptScore W2963992014C28826006 @default.
- W2963992014 hasConceptScore W2963992014C33923547 @default.
- W2963992014 hasConceptScore W2963992014C41008148 @default.
- W2963992014 hasConceptScore W2963992014C44292817 @default.
- W2963992014 hasConceptScore W2963992014C49555168 @default.
- W2963992014 hasConceptScore W2963992014C50644808 @default.
- W2963992014 hasConceptScore W2963992014C54848796 @default.
- W2963992014 hasConceptScore W2963992014C62520636 @default.
- W2963992014 hasConceptScore W2963992014C67820243 @default.
- W2963992014 hasConceptScore W2963992014C92207270 @default.
- W2963992014 hasConceptScore W2963992014C98763669 @default.
- W2963992014 hasLocation W29639920141 @default.
- W2963992014 hasOpenAccess W2963992014 @default.
- W2963992014 hasPrimaryLocation W29639920141 @default.
- W2963992014 hasRelatedWork W1522301498 @default.
- W2963992014 hasRelatedWork W1533861849 @default.
- W2963992014 hasRelatedWork W1632114991 @default.
- W2963992014 hasRelatedWork W1800356822 @default.
- W2963992014 hasRelatedWork W1815076433 @default.
- W2963992014 hasRelatedWork W2064675550 @default.
- W2963992014 hasRelatedWork W2107878631 @default.
- W2963992014 hasRelatedWork W2194775991 @default.
- W2963992014 hasRelatedWork W2474920236 @default.
- W2963992014 hasRelatedWork W2547718140 @default.
- W2963992014 hasRelatedWork W2557389081 @default.