7.5 KiB
7.5 KiB
full-title:: Generative AI: A new Gold Rush for software engineering innovation | VentureBeat site:: VentureBeat author:: Ashish Kakran, Thomvest Ventures labels:: generativeAI date-saved:: 14-08-2023 date-published:: 06-08-2023 date-archived:: 22-08-2023 is-archived:: 10 source:: Omnivore state:: archived
- collapsed:: true
* ### Highlights
collapsed:: true
- > For all the benefits that generative AI promises, voices are getting louder about the unintended societal effects of this technology. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#b52716a9-84fb-490b-9b55-b6c22ece3c8c)
- > It is the first time in the history of humanity that white-collar jobs stand to be automated, potentially rendering expensive degrees and years of experience meaningless. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#5e926a10-acfb-4733-a962-6a82de3dbfbb)
- > m and c represent the weights and biases, respectively, for an AI model. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#df0d164f-3ae7-4544-8e86-2fcc409d3a9d)
- > Representing the human brain would require a multi-dimensional space (called a vector) where infinite knowledge can be coded and stored for quick retrieval. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#0e2f9e35-b7f9-4e0e-91fa-a9a2a405054a)
- > Embeddings can be used to create text classifiers and to empower semantic search. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#fa5aa2a2-0499-42a8-810d-7593e08ff873)
- > For this magic to work, large clusters of GPUs and CPUs run nonstop for weeks or months to process the data the size of the entire Wikipedia website or the entire public internet to turn it into a mathematical equation where each time new data is processed, the weights and biases of the model change a little bit. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#a9b4be1a-0e8d-4808-b3d4-71a382e6ffe8)
- > watch _Ted Lasso_ [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#cdbdbe44-8751-49d4-9cbe-373449460dcb)
omnivore-note:: #TODO
- > Microsoft CEO Satya Nadella famously asked about generative AI, “OpenAI built this with 250 people; why do we have Microsoft Research at all?” [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#e7d5743e-ea5a-4789-88b6-f59ddf9e1d0d)
- > Why would you stop at a ten-billion-parameter model when you can train a massive general-purpose model with 500 billion parameters that can answer questions about any topic from any industry? [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#21cb06ec-c2a4-4b0d-bc56-ce8639b449ba)
- id:: 68584eb4-9919-41da-ab7f-d39dfb933470
> There has been a realization recently that we might have hit the limit of productivity gains that can be achieved by the size of a model. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#2c17576d-e8b9-477c-8557-933e82271565)
- > Independent evaluations of models have proved that there is no silver bullet, but the best model for an enterprise will be use-case specific. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#5c1588e0-b008-43d9-816e-f452bef888d5)
- > In the comprehensive evaluation completed by Stanford using models from openAI, Cohere, Anthropic and others, it was found that smaller models may perform better than their larger counterparts. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#6c8fc1ef-4578-4396-835f-8144ebd8d569)
omnivore-note:: #STAR
- > **_Confidence in wrong information_**: Someone with the confidence of an LLM has the potential to go far in life with little effort! Since these outputs are probabilistic and not deterministic, once a question is asked, the model may make up an answer and appear very confident. This is called [hallucination](https://venturebeat.com/ai/truera-launches-free-tool-for-testing-llm-apps-for-hallucinations/), and it is a major barrier to the adoption of LLMs in the enterprise. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#7901b77c-041c-4bf2-a258-6ec638e89b9c)
omnivore-note:: #STAR Hallucination of #LLMs
- > team restructuring is required to manage the massive volume of data that companies deal with today. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#bfbf0b95-814a-4867-8bb7-ba269c8b469a)
- > the data can leave the secure walls of an enterprise, and this is a problem because, in addition to a company’s secrets, this data might include PII/PHI data, which can invite regulatory action. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#f9ecc2f3-eb34-43f7-8795-ad3c0b07b3cf)
omnivore-note:: #security
- > Generative AI, however, offers many advantages over predictive AI depending on use cases. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#0dac93cd-82e8-44a4-aea4-a62f2995f876)
- > Generative AI today might be comparable to the cloud in 2008. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#f7d85ab1-2642-41f2-95ef-4ba71305fc43)
- > Generative AI today might be comparable to the cloud in 2008. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#59ad21d4-c983-4bd3-ad6a-67369a6f1432)
omnivore-note:: #star
- > Integrating generative AI into daily workflows is still a complex challenge for organizations large and small. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#6f63da88-ce40-4df5-9c29-8544467922de)
- > intelligence on top of LLMs. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#fdb4f39d-e9e1-4ea2-b329-1e682090a611)
- > Regulation is coming. It is just a matter of time before lawmakers around the world draft meaningful guardrails around this disruptive new technology. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#05f76848-7082-46b3-a135-a3781ec0926b)
- > AI can never replace the creativity and beauty of a human brain, which can think of ideas never thought before. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#3becfeea-a6e4-4812-ab10-a03e9fcf4712)
- > the code poets who know how to build amazing technology over the weekend will find AI a pleasure to work with and in no way a threat to their careers. [⤴️](https://omnivore.app/me/https-venturebeat-com-ai-generative-ai-a-new-gold-rush-for-softw-189f107a215#fad28b53-e48e-41ee-98f4-029b704aca67)