Recurrent Neural Networks

 

Sequence based models are mainly applied in NLP tasks and time series modelling 

Resources, blogs and links

• Colah Blog - Explains LSTM network 
• RNN - Andrej Karpathy explains RNN 
• Transformers - basic explanation of transformer networks 

 

Methods and networks 

• RNN 
• LSTM  
• Transformers- Attention is all you need 
• BERT - Pre-training of Deep Bidirectional Transformers for Language Understanding