Mistral AI

Nous développons les meilleurs modèles d'intelligence artificielle génératives.

Rejoignez nous ! https://jobs.lever.co/mistral/

Site web : https://mistral.ai

Mistral 7B

The best 7B model to date, Apache 2.0

Mistral 7B is a 7.3B parameter model that:

• Outperforms Llama 2 13B on all benchmarks
• Outperforms Llama 1 34B on many benchmarks
• Approaches CodeLlama 7B performance on code, while remaining good at English tasks
• Uses Grouped-query attention (GQA) for faster inference
• Uses Sliding Window Attention (SWA) to handle longer sequences at smaller cost

We’re releasing Mistral 7B under the Apache 2.0 license, it can be used without restrictions.

• Download it and use it anywhere (including locally) with our reference implementation
• Deploy it on any cloud (AWS/GCP/Azure), using vLLM inference server and skypilot
• Use it on HuggingFace

Mistral 7B is easy to fine-tune on any task. As a demonstration, we’re providing a model fine-tuned for chat, which outperforms Llama 2 13B chat.