### Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory. (arXiv:1911.07964v1 [cs.LG])

Several variants of recurrent neural networks (RNNs) with orthogonal or unitary recurrent matrices have recently been developed to mitigate the vanishing/exploding gradient problem and to model long-term dependencies of sequences. However, with the eigenvalues of the recurrent matrix on the unit circle, the recurrent state retains all input information which may unnecessarily consume model capacity.…