logseq/pages/Omnivore___21-10-2024___The Sequence Chat- Why Transformers are the Best Thing that Ever Happened to ...___.md

full-title:: The Sequence Chat: Why Transformers are the Best Thing that Ever Happened to NVIDIA site:: thesequence.substack.com author:: davide.diruscio@gmail.com labels:: Newsletter date-saved:: 21-10-2024 date-archived:: 21-10-2024 is-archived:: 10 source:: Omnivore state:: archived

- ### Highlights
  collapsed:: true
	- > Have you ever heard the phrase that the only company turning real profits in AI is NVIDIA? Well, transformers have a lot to do with that. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#e9f12d51-3975-4470-8506-f5dde242453c)
	- > **Technical:** The transformer architecture is the first model in which knowledge scales with pre, post training data without clear limits. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#29df5970-7f54-450b-98f2-84d67338f523)
	- > Market: The fact that transformers have become the dominant AI paradigm have given NVIDIA time to optimize its hardware for that architecture. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#6bd9455f-0bd0-498f-87d2-85e86bdcc140)
	- > **Scale:** Past certain scale, all transformer architectures are running using NVIDIA GPUs. [⤴️](https://omnivore.app/me/the-sequence-chat-why-transformers-are-the-best-thing-that-ever--192aefd995e#26989802-bddc-4131-879f-7892fbb058e0)