Commit ec23e21
authored
[GPU] Dyn quan bugfix for cache (#32582)
### Description of the issue(symptom, root-cause, how it was resolved)
- New attributes in dynamic quantization are missing from load/store in
caching
#### Reproduction step and snapshot (if applicable. Do not attach for
customer model)
- Two consecutive execution of WWB shows the issue on BMG
- $rm -rf minicpm-1b-sft/pytorch/ov/OV_FP16-INT8_ASYM//model_cache/ ;
python wwb.py --target-model
minicpm-1b-sft/pytorch/ov/OV_FP16-INT8_ASYM/ --device gpu.1 --gt-data
reference1.csv --num-sample 1 ; python wwb.py --target-model
minicpm-1b-sft/pytorch/ov/OV_FP16-INT8_ASYM/ --device gpu.1 --gt-data
reference1.csv --num-sample 1
#### Checklist
- [x] Is it a proper fix? (not a workaround)
- [x] Did you include test case for this fix, if necessary?
- [x] Did you review existing test that can be extended to cover this
scenario? Which test did you review?1 parent 4b3d6a7 commit ec23e21
File tree
2 files changed
+22
-0
lines changed- src/plugins/intel_gpu
- include/intel_gpu/primitives
- tests/unit/test_cases
2 files changed
+22
-0
lines changedLines changed: 8 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
| 55 | + | |
| 56 | + | |
55 | 57 | | |
56 | 58 | | |
57 | 59 | | |
| |||
70 | 72 | | |
71 | 73 | | |
72 | 74 | | |
| 75 | + | |
| 76 | + | |
73 | 77 | | |
74 | 78 | | |
75 | 79 | | |
| |||
81 | 85 | | |
82 | 86 | | |
83 | 87 | | |
| 88 | + | |
84 | 89 | | |
85 | 90 | | |
| 91 | + | |
86 | 92 | | |
87 | 93 | | |
88 | 94 | | |
| |||
94 | 100 | | |
95 | 101 | | |
96 | 102 | | |
| 103 | + | |
97 | 104 | | |
98 | 105 | | |
| 106 | + | |
99 | 107 | | |
100 | 108 | | |
101 | 109 | | |
| |||
Lines changed: 14 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
254 | 254 | | |
255 | 255 | | |
256 | 256 | | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
| 265 | + | |
| 266 | + | |
| 267 | + | |
| 268 | + | |
| 269 | + | |
| 270 | + | |
257 | 271 | | |
258 | 272 | | |
259 | 273 | | |
| |||
0 commit comments