[Spec Decode] Fix offline spec_decode.py (vllm-project#24257)

Signed-off-by: Ekagra Ranjan <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
Signed-off-by: xuebwang-amd <[email protected]>

Author: 2 people

vllm/benchmarks/datasets.py

@@ -1310,6 +1310,10 @@ def normalize(d: dict) -> dict[tuple[int, int, int], float]:
 
 
 def get_samples(args, tokenizer) -> list[SampleRequest]:
+
+    if not hasattr(args, "request_id_prefix"):
+        args.request_id_prefix = ""
+
     if args.dataset_name == "custom":
         dataset = CustomDataset(dataset_path=args.dataset_path)
         input_requests = dataset.sample(