full-title:: [Are we in an AI overhang? — LessWrong](https://omnivore.app/me/are-we-in-an-ai-overhang-less-wrong-18e1adf68ef) site:: [lesswrong.com](https://www.lesswrong.com/posts/N6vZEnCn6A95Xn39p/are-we-in-an-ai-overhang?s=09) author:: Andy Jones labels:: [[P1]] [[AI]] date-saved:: [[07-03-2024]] date-published:: [[27-07-2020]] source:: [[Omnivore]] state:: [[reading]] - ### Highlights - id:: 65f2aa95-0fe9-49c8-a094-2eff2d755895 > Google, Amazon and Microsoft each spend about $20bn/year on R&D and another $20bn each on capital expenditure. Very roughly, it totals to $100bn/year. Against this budget, dropping $1bn or more on scaling GPT up by another factor of 100x is entirely plausible _right now_. All that's necessary is that tech executives stop thinking of natural language processing as cutesy blue-sky research and start thinking in terms of quarters-till-profitability. [⤴️](https://omnivore.app/me/are-we-in-an-ai-overhang-less-wrong-18e1adf68ef#3768edc2-c47d-433e-aedd-10d2b5e4d6ba)