[Data] Add ray.dataset.expect() fro data quality checks#58434

Open

soffer-anyscale wants to merge 11 commits intomasterfrom

Commits on Nov 5, 2025

Add helper functions and ExpectationSuite for data quality expectations
soffer-anyscale
committed
Remove use_map_batches parameter from Dataset.expect()
soffer-anyscale
committed
Simplify Dataset.expect() API to match Ray Data patterns
soffer-anyscale
committed
Simplify ExpectationSuite to be more Pythonic and list-like
soffer-anyscale
committed
Simplify expectations API: only expect() is public
soffer-anyscale
committed
Simplify Dataset.expect() API: accept parameters directly
soffer-anyscale
committed
Simplify SLA API: rename optimization_strategy to optimize_for
soffer-anyscale
committed
Add ray.data.expectations API for data quality and SLA validation
soffer-anyscale
committed

Commits on Nov 6, 2025