Training Recurrent Neural Networks via Dynamical Trajectory-Based Optimization

The dataset used in this paper is a recurrent neural network with one hidden layer. The structure of the network is shown in Fig. 1. The input-output relation of the network is defined as: z(k) = π(u(k) + b z(k-1)), y˗(k) = v z(k).