FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2899962223> ?p ?o ?g. }

• W2899962223 endingPage "4535" @default.
• W2899962223 startingPage "4528" @default.
• W2899962223 abstract "Recurrent neural networks (RNNs) have been successfully used on a wide range of sequential data problems. A well known difficulty in using RNNs is the vanishing or exploding gradient problem. Recently, there have been several different RNN architectures that try to mitigate this issue by maintaining an orthogonal or unitary recurrent weight matrix. One such architecture is the scaled Cayley orthogonal recurrent neural network (scoRNN) which parameterizes the orthogonal recurrent weight matrix through a scaled Cayley transform. This parametrization contains a diagonal scaling matrix consisting of positive or negative one entries that can not be optimized by gradient descent. Thus the scaling matrix is fixed before training and a hyperparameter is introduced to tune the matrix for each particular task. In this paper, we develop a unitary RNN architecture based on a complex scaled Cayley transform. Unlike the real orthogonal case, the transformation uses a diagonal scaling matrix consisting of entries on the complex unit circle which can be optimized using gradient descent and no longer requires the tuning of a hyperparameter. We also provide an analysis of a potential issue of the modReLU activiation function which is used in our work and several other unitary RNNs. In the experiments conducted, the scaled Cayley unitary recurrent neural network (scuRNN) achieves comparable or better results than scoRNN and other unitary RNNs without fixing the scaling matrix." @default.
• W2899962223 created "2018-11-16" @default.
• W2899962223 creator A5046489066 @default.
• W2899962223 creator A5056789912 @default.
• W2899962223 creator A5062950866 @default.
• W2899962223 date "2019-07-17" @default.
• W2899962223 modified "2023-09-26" @default.
• W2899962223 title "Complex Unitary Recurrent Neural Networks Using Scaled Cayley Transform" @default.
• W2899962223 doi "https://doi.org/10.1609/aaai.v33i01.33014528" @default.
• W2899962223 hasPublicationYear "2019" @default.
• W2899962223 type Work @default.
• W2899962223 sameAs 2899962223 @default.
• W2899962223 citedByCount "20" @default.
• W2899962223 countsByYear W28999622232019 @default.
• W2899962223 countsByYear W28999622232020 @default.
• W2899962223 countsByYear W28999622232021 @default.
• W2899962223 countsByYear W28999622232022 @default.
• W2899962223 countsByYear W28999622232023 @default.
• W2899962223 crossrefType "journal-article" @default.
• W2899962223 hasAuthorship W2899962223A5046489066 @default.
• W2899962223 hasAuthorship W2899962223A5056789912 @default.
• W2899962223 hasAuthorship W2899962223A5062950866 @default.
• W2899962223 hasBestOaLocation W28999622231 @default.
• W2899962223 hasConcept C106487976 @default.
• W2899962223 hasConcept C11413529 @default.
• W2899962223 hasConcept C118615104 @default.
• W2899962223 hasConcept C121332964 @default.
• W2899962223 hasConcept C130367717 @default.
• W2899962223 hasConcept C132525143 @default.
• W2899962223 hasConcept C147168706 @default.
• W2899962223 hasConcept C153258448 @default.
• W2899962223 hasConcept C154945302 @default.
• W2899962223 hasConcept C159985019 @default.
• W2899962223 hasConcept C17744445 @default.
• W2899962223 hasConcept C18586221 @default.
• W2899962223 hasConcept C187064257 @default.
• W2899962223 hasConcept C192562407 @default.
• W2899962223 hasConcept C199539241 @default.
• W2899962223 hasConcept C202887219 @default.
• W2899962223 hasConcept C203776342 @default.
• W2899962223 hasConcept C22149727 @default.
• W2899962223 hasConcept C2524010 @default.
• W2899962223 hasConcept C33923547 @default.
• W2899962223 hasConcept C41008148 @default.
• W2899962223 hasConcept C44292817 @default.
• W2899962223 hasConcept C50644808 @default.
• W2899962223 hasConcept C62520636 @default.
• W2899962223 hasConcept C67820243 @default.
• W2899962223 hasConcept C74902906 @default.
• W2899962223 hasConcept C96214315 @default.
• W2899962223 hasConcept C99844830 @default.
• W2899962223 hasConceptScore W2899962223C106487976 @default.
• W2899962223 hasConceptScore W2899962223C11413529 @default.
• W2899962223 hasConceptScore W2899962223C118615104 @default.
• W2899962223 hasConceptScore W2899962223C121332964 @default.
• W2899962223 hasConceptScore W2899962223C130367717 @default.
• W2899962223 hasConceptScore W2899962223C132525143 @default.
• W2899962223 hasConceptScore W2899962223C147168706 @default.
• W2899962223 hasConceptScore W2899962223C153258448 @default.
• W2899962223 hasConceptScore W2899962223C154945302 @default.
• W2899962223 hasConceptScore W2899962223C159985019 @default.
• W2899962223 hasConceptScore W2899962223C17744445 @default.
• W2899962223 hasConceptScore W2899962223C18586221 @default.
• W2899962223 hasConceptScore W2899962223C187064257 @default.
• W2899962223 hasConceptScore W2899962223C192562407 @default.
• W2899962223 hasConceptScore W2899962223C199539241 @default.
• W2899962223 hasConceptScore W2899962223C202887219 @default.
• W2899962223 hasConceptScore W2899962223C203776342 @default.
• W2899962223 hasConceptScore W2899962223C22149727 @default.
• W2899962223 hasConceptScore W2899962223C2524010 @default.
• W2899962223 hasConceptScore W2899962223C33923547 @default.
• W2899962223 hasConceptScore W2899962223C41008148 @default.
• W2899962223 hasConceptScore W2899962223C44292817 @default.
• W2899962223 hasConceptScore W2899962223C50644808 @default.
• W2899962223 hasConceptScore W2899962223C62520636 @default.
• W2899962223 hasConceptScore W2899962223C67820243 @default.
• W2899962223 hasConceptScore W2899962223C74902906 @default.
• W2899962223 hasConceptScore W2899962223C96214315 @default.
• W2899962223 hasConceptScore W2899962223C99844830 @default.
• W2899962223 hasIssue "01" @default.
• W2899962223 hasLocation W28999622231 @default.
• W2899962223 hasLocation W28999622232 @default.
• W2899962223 hasOpenAccess W2899962223 @default.
• W2899962223 hasPrimaryLocation W28999622231 @default.
• W2899962223 hasRelatedWork W1974515944 @default.
• W2899962223 hasRelatedWork W1979210850 @default.
• W2899962223 hasRelatedWork W2039837266 @default.
• W2899962223 hasRelatedWork W2043692301 @default.
• W2899962223 hasRelatedWork W2048912603 @default.
• W2899962223 hasRelatedWork W2359223374 @default.
• W2899962223 hasRelatedWork W2787163288 @default.
• W2899962223 hasRelatedWork W2899962223 @default.
• W2899962223 hasRelatedWork W2951197226 @default.
• W2899962223 hasRelatedWork W2951303138 @default.
• W2899962223 hasVolume "33" @default.
• W2899962223 isParatext "false" @default.
• W2899962223 isRetracted "false" @default.
• W2899962223 magId "2899962223" @default.

• next