> ## Content Index
> Fetch the complete content index at: https://www.testingcatalog.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# New Codestral 25.01 sets FIM performance benchmark in AI coding
- URL: https://www.testingcatalog.com/new-codestral-25-01-sets-fim-performance-benchmark-in-ai-coding/
- Published: 2025-01-13T22:22:55.000Z
- Updated: 2025-01-13T22:26:07.000Z
- Author: Alexey Shabanov
- Tags: Mistral, Latest AI News

Mistral AI has announced the release of **Codestral 25.01**, an upgraded version of its state-of-the-art coding model designed to enhance software development workflows. This release builds on the success of the original Codestral model, which has been widely adopted by developers for tasks such as code generation, fill-in-the-middle (FIM), code correction, and test generation.

### Codestral 25.01

Codestral 25.01 introduces several advancements over its predecessor:

1. **Improved Architecture**: The model is now approximately twice as fast in generating and completing code, thanks to architectural optimizations and a more efficient tokenizer.
2. **Expanded Context Length**: With a context length of 256k tokens, it supports larger codebases and more complex tasks.
3. **Performance Benchmarks**: Codestral 25.01 outperforms leading sub-100B parameter coding models in FIM tasks across multiple programming languages. For instance:
  1. It achieves an average FIM pass@1 score of **95.3%**, surpassing competitors like OpenAI's GPT-3.5 Turbo API and DeepSeek Coder models.
  2. On HumanEval benchmarks, it scores **86.6%** for Python and maintains strong performance across other languages such as JavaScript (82.6%) and Java (72.8%).

> BREAKING 🚨: Mistral AI is preparing to release Codestral 25.01 with 256k context length 🔥  
>  
> "Code at the speed of Tab. Available today in Continue dot dev and soon on other leading AI code assistants."   
>  
> h/t [@ai\_for\_success](https://twitter.com/ai%5Ffor%5Fsuccess?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com) [pic.twitter.com/Ow9RYKL0UP](https://t.co/Ow9RYKL0UP?ref=testingcatalog.com)
> 
> — TestingCatalog News 🗞 (@testingcatalog) [January 13, 2025](https://twitter.com/testingcatalog/status/1878841542628245697?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com)

The model is tailored for high-frequency, low-latency use cases, making it ideal for developers seeking faster and more accurate code assistance.

### The Company Behind It: Mistral AI

Mistral AI has positioned itself as a leader in AI-driven coding solutions. Known for its lightweight and efficient models, the company focuses on improving developer productivity through cutting-edge tools like Codestral.

> Exciting news from [@CopilotArena](https://twitter.com/CopilotArena?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com)!  
>  
> The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #1, +12 points over previous Codestral!). Congrats to [@MistralAI](https://twitter.com/MistralAI?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com)🎆  
>  
> Try out the new model today in the [@CopilotArena](https://twitter.com/CopilotArena?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com) VSCode extension. [pic.twitter.com/N6pAeKrYbm](https://t.co/N6pAeKrYbm?ref=testingcatalog.com)
> 
> — lmarena.ai (formerly lmsys.org) (@lmarena\_ai) [January 13, 2025](https://twitter.com/lmarena%5Fai/status/1878872916596806069?ref%5Fsrc=twsrc%5Etfw&ref=testingcatalog.com)

### Availability

Codestral 25.01 is available starting today:

1. Developers can access it through IDE plugins for platforms like Visual Studio Code and JetBrains.
2. For enterprise users requiring local deployment or data residency, the model is offered via Continue’s platform.
3. The API is accessible on Google Cloud’s Vertex AI, with private previews on Azure AI Foundry and plans to launch on Amazon Bedrock.

### Why This Matters

This release underscores [Mistral AI's](https://www.testingcatalog.com/tag/mistral/) commitment to advancing coding models that cater to real-world developer needs. By prioritizing FIM capabilities and efficiency, Codestral 25.01 addresses critical challenges in software development, such as reducing coding errors and accelerating project timelines.

With its debut at #1 on the LMsys copilot arena leaderboard, Codestral 25.01 sets a new benchmark for coding assistants in its category. Developers worldwide are encouraged to explore its capabilities through free demos or integrate it into their workflows via APIs or IDE plugins.

[Source](https://mistral.ai/news/codestral-2501/?ref=testingcatalog.com)