Skip to content

Commit c0b9e25

Browse files
committed
bugfix:handshake_port error
Signed-off-by: chenxiao <[email protected]>
1 parent fe8f042 commit c0b9e25

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/distributed/mooncake_connector.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -200,7 +200,7 @@ def run(self):
200200
# NOTE(rob): we need each rank to have a unique port. This hack to keeps
201201
# us moving. We will switch when moving to etcd or where we have a
202202
# single ZMQ socket in the scheduler.
203-
device_index = self.pp_rank + self.tp_size + self.tp_rank + self.pcp_rank * self.prefill_tp_size
203+
device_index = self.pp_rank * self.tp_size + self.tp_rank + self.pcp_rank * self.prefill_tp_size
204204
handshake_port = self.side_channel_port + device_index
205205
path = make_zmq_path("tcp", self.side_channel_host, handshake_port)
206206
logger.info("Starting listening on path: %s", path)

0 commit comments

Comments
 (0)