Machine Learning Glossary: Difference between revisions
| Line 2: | Line 2: | ||
==A== | ==A== | ||
* Attention - An component of transformers which involves computing the product of query | * Attention - An component of transformers which involves computing the product of query and key embeddings to compute the interaction between elements. | ||
==B== | ==B== | ||