Transformer (machine learning model): Difference between revisions
Created page with "{{main | Wikipedia: Transformer (machine learning model)}}" |
No edit summary |
||
| Line 1: | Line 1: | ||
{{main | Wikipedia: Transformer (machine learning model)}} | {{main | Wikipedia: Transformer (machine learning model)}} | ||
[https://arxiv.org/abs/1706.03762 Attention is all you need paper]<br> | |||
A neural network architecture by Google. | |||
It is currently the best at NLP tasks and has mostly replaced RNNs for these tasks. | |||
;Guides and explanations | |||
* [https://nlp.seas.harvard.edu/2018/04/03/attention.html The Annotated Transformer] | |||
* [https://www.youtube.com/watch?v=iDulhoQ2pro Youtube Video] | |||
Revision as of 14:34, 5 December 2019
Attention is all you need paper
A neural network architecture by Google.
It is currently the best at NLP tasks and has mostly replaced RNNs for these tasks.
- Guides and explanations