topologySpreadConstraints have to be defined as a list, not as a map. This is causing an error when you define it and it doesn't actually work.
When you run helm template . --values values.yaml with the tsc defined you will run into this issue
coalesce.go:286: warning: cannot overwrite table with non table for ray.ray-cluster.worker.topologySpreadConstraints (map[])
This is the case for all sections where the tsc is set as an empty map.
The fix is to have it defined as an empty list instead like so topologySpreadConstraint: []