Mistral AI SAS today opened access to Mistral Large 4, its most capable large language model to date.

On launch, the LLM is available in public preview through the company’s cloud platform. Mistral plans to release the model’s weights later this month.

Mistral Large 4 features a mixture of experts architecture with 1 trillion parameters. It only uses 49 billion parameters at a time, which is more hardware-efficient than activating the entire model when a user enters a prompt. Mistral says that the LLM can answer questions across more than 160 languages.

The new model earned a top five score on the AA Cyber Index, a collection of benchmarks that measures LLMs’ ability to find and fix software vulnerabilities. The model proved particularly adept at patching open-source projects. Mistral Large 4 earned an AA Cyber Index score of 82% in that department, which put it ahead of open-source rivals. 

Mistral says computer vision is another strong suit of its LLM. It outperformed GPT-6 Astra by 1% on Dense200, a benchmark that measures models’ ability to find objects of interest in images.

Mistral Large 4 falls well behind frontier models such as Astra on the AI industry’s most popular coding benchmarks. However, it outperforms several leading open-source LLMs including Qwen3.8 Max and DeepSeek V4 Pro. It also scored higher than the latter model on the AutomationBench and AA-Briefcase knowledge work benchmarks. The former test comprises relatively simple tasks, while the latter includes assignments that would take a human weeks to complete.

Mistral trained Large 4 on 3,800 Grace Blackwell chips. Each accelerator combines two of Nvidia Corp.’s Blackwell graphics cards with one central processing unit. The company didn’t specify how long the training run took. It did, however, share other details about the project.

Advanced LLMs are trained through trial and error. The model being developed receives a task and attempts to complete it without human guidance. Each such exercise is known as a rollout. At the end of a rollout, a specialized AI model analyzes the results and uses them to refine the LLM.

According to Mistral, its engineers developed a software stack that can run tens of thousands of rollouts in parallel. It assembles rollouts from a library of AI building blocks. Those modules include sandboxes in which LLMs can run code, a search engine that facilitates web access and tests for checking rollout results. The software stack was used to develop Mistral Large 4.

The model’s rollouts produced 33 billion tokens per day. Mistral used just under half of those tokens to power the training workflow that was responsible for refining Large 4. The rollouts and training workflow were asynchronous, which means that a delay in one workload doesn’t slow down the other. That helped Mistral speed up processing.

Notably, the company didn’t pause the training run that produced Large 4 after creating the current iteration of the model. Mistral expects the workflow to produce larger, more capable versions of the LLM in the coming months. In the longer term, the company will use Mistral Large 4 to build an entire series of models optimized for specific use cases. 

Image: Mistral AI