5.8.1
Patch release v5.8.1
Patch release v5.8.1
This release is mainly to fix the Deepseek V4 integration!!!
- [fix] Add fatal_error to ContinuousBatchingManager so the serving... by @qgallouedec, @remi-or
- Fix WeightConverter regex incorrectly matching shared_experts as experts by @silencelamb, @claude
- Fix deepseek v4 by @ArthurZucker (#45892)
- Deepseek v4 csa mask collapse by @ArthurZucker, @Sawyer117 (#45928)