Skip to content

Conversation

@jihoonson
Copy link
Collaborator

Fixes #204.

The issue is that the PysparkBenchReport class nds_h_power.py uses is util/python_benchmark_reporter/PysparkBenchReport.py, whereas the PysparkBenchReport class modified in #202 is nds/PysparkBenchReport.py. As the former was not modified to support new arguments, the nds_h script fails. I rather reverted my change for nds-h in this PR than fixing the util/python_benchmark_reporter/PysparkBenchReport.py file. It seems strange to have duplicate classes, one for nds and another for nds-h. We should just consolidate them.

@jihoonson jihoonson force-pushed the revert-iterations-nds-h branch from 0f1472b to 55636bc Compare March 14, 2025 02:15
pxLi
pxLi previously approved these changes Mar 14, 2025
@pxLi pxLi dismissed their stale review March 14, 2025 02:27

dismiss

@pxLi
Copy link
Member

pxLi commented Mar 14, 2025

We have other issue (also reported in #204) with nds_maintenance.py script which is relying on the nds/PysparkBenchReport.py. I thought you would revert the whole #202, No?

@jihoonson
Copy link
Collaborator Author

Thanks @pxLi. Didn't realize that there are more than one issues. Closing this PR in favor of #207.

@jihoonson jihoonson closed this Mar 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] PysparkBenchReport report_on failed in ndsh.sh and nds_maintenance.py

2 participants