Jump to content

Transformer (machine learning model): Difference between revisions

no edit summary
(Created page with "{{main | Wikipedia: Transformer (machine learning model)}}")
 
No edit summary
Line 1: Line 1:
{{main | Wikipedia: Transformer (machine learning model)}}
{{main | Wikipedia: Transformer (machine learning model)}}
[https://arxiv.org/abs/1706.03762 Attention is all you need paper]<br>
A neural network architecture by Google.
It is currently the best at NLP tasks and has mostly replaced RNNs for these tasks.
;Guides and explanations
* [https://nlp.seas.harvard.edu/2018/04/03/attention.html The Annotated Transformer]
* [https://www.youtube.com/watch?v=iDulhoQ2pro Youtube Video]