dlinfer release v0.2.3.post2

• 支持华为A3
• 支持华为aclgraph

dlinfer release v0.2.2

• 华为
  • 支持A3上的Qwen系列
  • 修复图模式下的内存泄漏问题
• 沐曦
  • Refine代码。适配最新软件栈。

dlinfer release v0.2.1.post2

华为

• 多卡下默认使用ray，修复稳定性问题
• 其他bug fix

v0.1.8

华为

• MoE优化

What's Changed

• revert ci by @jinminxi104 in #198
• [ascend]remove attention patch in lmdeploy by @yao-fengchen in #194
• [feat]support ascend w8a8 graph_mode by @yao-fengchen in #191
• Refactor rope by @yao-fengchen in #199
• change ci setting by @jinminxi104 in #202
• fix ascend awq by @yao-fengchen in #204
• [ascend]Optimize moe by @yao-fengchen in #203
• Bump018 by @jinminxi104 in #209

Full Changelog: v0.1.7...v0.1.8

dlinfer release v0.1.7

华为&沐曦

• 支持多节点
• 支持mla，支持dsv2

What's Changed

• [maca] support deepseekv2 for maca backend. by @Reinerzhou in #133
• [camb]fix fused_moe param order by @JackWeiw in #173
• [camb]add w8a8 support by @JackWeiw in #176
• [ascend] add new_empty op and opt reshape ops by @tangzhiyi11 in #178
• fix glm-4v by @jinminxi104 in #184
• revert ci by @jinminxi104 in #187
• default enable npu launch by @jinminxi104 in #188
• [ascend] support multi ndoes by @tangzhiyi11 in #190
• [maca] support multinode for maca. by @Reinerzhou in #192
• [ascend] remove allreduce group in eager mode by @tangzhiyi11 in #193
• [ascend]support mla by @yao-fengchen in #182
• bump version to 0.1.7 by @jinminxi104 in #195

Full Changelog: v0.1.6...v0.1.7

dlinfer release v0.1.6

• performance up on Ascend platform!
  • reaches almost the same performance as MindIE on most dense models with both single and multiple cards.

dlinfer release v0.1.5

• 华为，沐曦，寒武纪上均支持InternLM3-8B
• 沐曦
  • 支持cudagraph
• 寒武纪
  • 完成代码合并，支持InternLM/InternVL/LLaMA/Qwen(VL)系列/Mixtral8x7B

dlinfer release v0.1.3.post1

• 华为

  • 支持int8的kv cache
  • 修复w4a16方面的bug

• 沐曦

  • 支持w4a16
  • 支持多种数据排布的Linear计算
  • 支持最新沐曦软件栈
  • 修复多轮对话

dlinfer release v0.1.2

• 华为
  • support multi-card on graph mode
  • support mistral8x7b on graph mode
  • support more models on eager mode
• 沐曦
  • code refinement

dlinfer release v0.1.1.post2

版本

v0.1.1.post2

更新内容

1. 支持沐曦C500加速卡
2. 支持华为图模式（llama3-8B/llama2-7B/Qwen2-7B）
3. 华为支持W4A16量化与推理
4. 其他华为与沐曦平台优化