Meta introduced the launch of Llama 3, the newest model of its giant language mannequin (LLM), on April 18, describing it as a “main leap over Llama 2.”
The corporate mentioned it has initially launched the primary two fashions of the present model, that includes 8B and 70B parameters, with upcoming fashions slated to function 400B parameters.
Meta emphasised Llama 3 was educated with a “giant, high-quality coaching dataset” that includes over 15 trillion tokens, 7x bigger than Llama 2 and that includes 4x extra code. Llama 3 additionally options filtering methods, together with NSFW filters, to make sure knowledge high quality.
LLama 3 outperforms Llama 2 and competing fashions resembling Anthropic’s Claude Sonnet, Mistral Medium, and OpenAI’s Chat GPT-3.5 greater than half the time throughout 12 use circumstances.
The primary releases of Llama 3 are text-based fashions. Nonetheless, future releases shall be multilingual and multimodal. They may even function longer context and display higher efficiency in reasoning and coding, which Meta described as “core LLM capabilities.”
The corporate plans to deploy Llama 3 on all main cloud suppliers, mannequin API suppliers, and different companies. It plans to launch the product “in every single place.”
Broader person entry
Llama 3 is geared toward builders, however Meta has also launched new methods for finish customers to entry AI companies within the US and greater than 12 different international locations.
One new addition is a devoted web site referred to as Meta AI, the place customers can entry AI-powered writing help, trivia video games, simulated job interviews, and homework assist.
Meta has additionally built-in Meta AI with all its merchandise, together with Fb, Instagram, WhatsApp, and Messenger. Moreover, the corporate presents the service by way of Ray-Ban Meta good glasses within the US and plans to increase it to its Meta Quest VR headset.
In an announcement, CEO Mark Zuckerberg mentioned:
“We consider that Meta AI is now probably the most clever AI assistant which you can freely use.”
Information of Meta’s expanded AI merchandise comes shortly after upgrades to competing companies. ChatGPT upgraded to GPT-4 Turbo on April 11, whereas Microsoft Copilot upgraded to GPT-4 Turbo beginning in March, advancing the race between consumer-oriented AI companies.