2.6 KiB
2.6 KiB
full-title:: Nobody Likes a Know-It-All: Smaller LLMs are Gaining Momentum site:: thesequence.substack.com author:: davide.diruscio@gmail.com labels:: Newsletter LLMs date-saved:: 28-04-2024 date-archived:: 02-05-2024 is-archived:: 10 source:: Omnivore state:: archived
- ### Highlights
collapsed:: true
- > Massively large foundation models are likely to dominate generalist use cases, but they remain incredibly expensive to run, plagued with hallucinations, security vulnerabilities, and reliability issues when applied in domain-specific scenarios. [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#eddd34f6-fd0b-4fe0-b92c-1f49fb50166e)
- > Microsoft released the Phi-3 family of models. [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#159d8388-53a6-4b9e-8244-191498aef203)
- > Apple open-sourced OpenELM, a family of LLMs optimized for mobile scenarios. [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#cdaf6f6d-2542-4728-97e1-8ec1b60e9594)
- > Phi-3, their famous small language model that excel at match and computer science task. [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#c768a0fd-0511-4768-a797-8c808c15bf28)
- > #### MAIA
>
Researchers from MIT published a paper introducing **M**ultimodal **A**utomated **I**nterpretability **A**gent (MAIA), an AI agent that can design experiments to answer queries of other AI models. The method is an interesting approach to interpretability to prove generative AI models to undestand their behavior [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#c82046e9-30c4-4770-b552-e5a2fc793e4e)
omnivore-note:: [[PROJECTS/MOSAICO]] #omnivore-note-color
- > Google DeepMind open sourced Penzai, a research tookit for editing and visualizing neural networks and inject custom logic [⤴️](https://omnivore.app/me/nobody-likes-a-know-it-all-smaller-ll-ms-are-gaining-momentum-18f246410df#21eb992b-ae4d-4ba7-ae83-df75a2cc7d92)