feat(io): support HDFS by HdfsStoreProvider

[fMeow]

This PR close #2140.

[chatgpt-codex-connector]

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

[codecov]

Codecov Report

❌ Patch coverage is 6.66667% with 14 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
rust/lance-io/src/object_store/providers/hdfs.rs	0.00%	14 Missing ⚠️

📢 Thoughts on this report? Let us know!

[fMeow]

@Xuanwo I change the underlying storage backend from hdfs native object store to opendal.

However, I found the version of opendal in lance obselete. In opendal 0.55, it bump the version of hdfs-native to 0.13. I need a critical feature that introduced in hdfs-natie 0.12.

Any idea when will lance upgrade the version of opendal dependency to 0.55?

[Xuanwo]

Any idea when will lance upgrade the version of opendal dependency to 0.55?

It's ok to upgrade it for now. Would you like to start a PR for this?

[fMeow]

sure