Meta AI released the latest generation of open-source large model, Llama 2, on Tuesday. Compared to Llama 1, which was released in February of this year, Llama 2 uses twice the number of tokens for training, reaching 20 trillion, and the context length limit has also doubled. Llama 2 includes models with 7 billion, 13 billion, and 70 billion parameters.
In addition, Meta also announced a collaboration with Microsoft Azure cloud services to launch cloud services based on the Llama 2 model for global developers. This collaboration signifies a deep partnership between Meta and Microsoft, and the official launch of the next generation open-source large language model, Llama 2. It is also announced that this model will be provided for free for research and commercial use. Compared to Llama 1, Llama 2 has a 40% increase in training data, a context length that is twice as long as Llama 1, and utilizes grouped query attention mechanism.
Specifically, the pre-training model of Llama 2 was trained on 20 trillion tokens, while the fine-tuned Chat model was trained on 1 million human-labeled data.
Meta AI Llama 2 official introduction page: https://941ai.com/zyur
Llama 2 official paper address: https://941ai.com/dyog
Llama Github official open-source code website: https://github.com/facebookresearch/llama
Dedicated to discovering the new world of artificial intelligence,
Continuously updating current popular AI tutorials and news!
Stay tuned to AI Exploration Station and explore the mysterious world of AI with us!
https://941ai.com/meta-llama2-1188.html