Open is the way (Interview)

AI Strategies

Joseph Jacks discusses the strategic decisions behind Meta's open-source release of Llama models, highlighting the industry's shift towards more accessible AI technologies. He notes that Meta's decision to open-source Llama is not merely an act of generosity but a strategic move to shape industry standards and foster innovation. This approach contrasts with companies like OpenAI, which focus on monetizing their AI models. Jacks explains, "There's actually a choice now in the industry where you can say, I'm going to use a proprietary AI model and all these trade-offs, or I can just take Llama, it's a few gigabytes, and I can run it on some servers and get the same capability, and it's 50% to 100% less expensive." 1 2

   

Tech Challenges

The discussion shifts to the technical challenges of AI model development, particularly the inefficiencies of current transformer architectures. Jacks compares the energy consumption of these models to the human brain, emphasizing the need for more efficient solutions. He states, "The human brain is, like many, many, many orders of magnitude more energy efficient than the state of the art neural nets that are getting produced today." 3 4

   

Market Dynamics

In comparing market players, Jacks highlights Meta's unique position with its vast resources and open-source strategy. He contrasts this with other companies like OpenAI and Anthropic, which struggle to match Meta's scale. Jacks notes, "Meta is literally doing this. They have hundreds of thousands of h 100s equivalent from the last report... and they're literally just getting started with, like, scaling all this infrastructure." 5 6