16 lines
1.9 KiB
Markdown
16 lines
1.9 KiB
Markdown
full-title:: [The Sequence Chat: Why Transformers are the Best Thing that Ever Happened to NVIDIA](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e)
|
|
site:: [thesequence.substack.com](https://thesequence.substack.com/p/the-sequence-chat-why-transformers?isFreemail=true&post_id=150511653&publication_id=54309&r=z2w67&token=eyJ1c2VyX2lkIjo1ODkyMTU2NywicG9zdF9pZCI6MTUwNTExNjUzLCJpYXQiOjE3Mjk1MTE5NTgsImV4cCI6MTczMjEwMzk1OCwiaXNzIjoicHViLTU0MzA5Iiwic3ViIjoicG9zdC1yZWFjdGlvbiJ9.7z1R7V4xSAJRvtnnBGl_3mr6p9Q1DvSAX19R6R7M5Q4&triedRedirect=true)
|
|
author:: davide.diruscio@gmail.com
|
|
labels:: [[Newsletter]]
|
|
date-saved:: [[21-10-2024]]
|
|
date-archived:: [[21-10-2024]]
|
|
is-archived:: 10
|
|
source:: [[Omnivore]]
|
|
state:: [[archived]]
|
|
|
|
- ### Highlights
|
|
collapsed:: true
|
|
- > Have you ever heard the phrase that the only company turning real profits in AI is NVIDIA? Well, transformers have a lot to do with that. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#e9f12d51-3975-4470-8506-f5dde242453c)
|
|
- > **Technical:** The transformer architecture is the first model in which knowledge scales with pre, post training data without clear limits. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#29df5970-7f54-450b-98f2-84d67338f523)
|
|
- > Market: The fact that transformers have become the dominant AI paradigm have given NVIDIA time to optimize its hardware for that architecture. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#6bd9455f-0bd0-498f-87d2-85e86bdcc140)
|
|
- > **Scale:** Past certain scale, all transformer architectures are running using NVIDIA GPUs. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#26989802-bddc-4131-879f-7892fbb058e0) |