Meta’s seeking to make a much bigger push into generative AI, through a brand new LLM system that it hopes will make it the chief within the AI race.
In keeping with The Wall Road Journal, Meta’s at the moment constructing a brand new AI system, which it hopes will finally rival OpenAI’s GPT techniques in compute energy and complexity. The system will construct on Meta’s present Llama fashions, and produce Meta up to the mark with others within the generative AI race.
As per WSJ:
“The deliberate system, particulars of which may nonetheless change, would assist different firms to construct companies that produce subtle textual content, evaluation and different output. It’s the work of a gaggle shaped early this 12 months by Meta Chief Govt Mark Zuckerberg to speed up growth of so-called generative AI instruments that may produce humanlike expressions.”
Certainly, varied reviews have advised that Zuckerberg turned “obsessed” with AI after seeing the early hype round ChatGPT, which has modified the route of lots of Meta’s tasks, and diminished its emphasis on the metaverse, its longer-term VR wager.
Although that additionally stays a key factor in Meta’s planning. However generative AI has opened up new alternatives, and Meta is uniquely positioned to faucet into such, based mostly on its unmatched databanks, and systematic sources.
On the latter, WSJ additionally reviews that Meta’s at the moment within the strategy of buying extra Nvidia H100 chips to energy its AI ambitions. Nvidia chips are in excessive demand, and restricted provide at current, which, at a base degree, signifies that the corporate with essentially the most chips stands one of the best likelihood to win out within the broader AI growth race.
Earlier this 12 months, Elon Musk reportedly bought 10,000 GPUs for his generative AI venture.
It’ll be attention-grabbing to see how Meta plans to deploy its personal AI and LLM instruments, and the way they’ll be built-in into its in-app experiences. Meta’s already experimenting with a variety of AI-powered components, together with visible creation instruments and an Instagram chatbot.
Perhaps, by means of a extra superior AI system, it’ll look to reinforce and enhance these experiences, whereas additionally using higher-end AI inside its advert focusing on and creation course of.
Total, it’s little shock to see Meta seeking to make a much bigger transfer within the AI area, given its long-term work on this space, and the potential it has to compete, based mostly on its trove of conversational information and interplay. With these issues factored in, it does seem to be Meta ought to be capable of create a greater AI mannequin, and it’ll be attention-grabbing to see how, precisely, it appears to be like to deploy and make the most of such techniques.
In keeping with WSJ, Meta expects to begin coaching its new AI system in early 2024. No phrase but on a public launch timeline.
