Search results

[Feature] New Speculative Decoding Framework

enhancementNew feature or requestNew feature or request

Status: Open.

Task

#304 In alibaba/rtp-llm;

· Vinkle-hzt opened on Oct 31, 2025

Do you support Huawei Ascend NPU?

Status: Open.

#281 In alibaba/rtp-llm;

· IBaojunZhou opened on Oct 28, 2025

注意力头维度为32会报错，有什么办法可以支持注意力维度为32的吗

Status: Open.

#141 In alibaba/rtp-llm;

· Abladol opened on Aug 8, 2025

支持在 H800上跑 int8 weight only 吗？

Status: Open.

#140 In alibaba/rtp-llm;

· hongqing1986 opened on Jul 14, 2025

Why balance according to batch size in a technical report?

Status: Open.

#139 In alibaba/rtp-llm;

· nannaer opened on Jun 23, 2025

源码编译bazelisk build下载依赖失败，请问该如何操作

Status: Open.

#138 In alibaba/rtp-llm;

· liweiqing1997 opened on Jun 12, 2025

git clone failed with error: git-lfs: command not found

Status: Open.

#137 In alibaba/rtp-llm;

· zhaohaidao opened on May 31, 2025

socket.gaierror: [Errno -5] No address associated with hostname

Status: Open.

#136 In alibaba/rtp-llm;

· Greatpanc opened on Apr 15, 2025

MODEL_TYPE 需要填写的是什么内容，参考文档中不是很清晰

Status: Open.

#135 In alibaba/rtp-llm;

· Greatpanc opened on Apr 15, 2025

最新代码源码编译报错

Status: Open.

#132 In alibaba/rtp-llm;

· leyiwang opened on Feb 24, 2025

what's the decode token speed of 7b qwen gptq int4 model on v100?

Status: Open.

#131 In alibaba/rtp-llm;

· FWXT opened on Feb 20, 2025

Is there any tutorial document on how to use pd-disaggregation?

Status: Open.

#130 In alibaba/rtp-llm;

· Dimensionzw opened on Feb 7, 2025