[Feature Request]: Enhance Error Handling in FileSystem Imports to Improve Troubleshooting about beam HOT 4 OPEN

I like your idea. Thanks for opening this issue.

from beam.

filesystem extensions [gcp],[s3],etc are optional dependencies of beam. #31219 will cause excessive warning raised if user not intended to install these dependencies. Can we improve the error message you referred in the description instead?

Unable to get filesystem from specified path, please use the correct path or ensure the required dependency is installed, e.g., pip install apache-beam[gcp]. Path specified: ...

to, e.g.

Unable to get filesystem of scheme "s3://" from specified path

from beam.

Even better, currently it hints 'e.g., pip install apache-beam[gcp]. If the failed scheme is gs://, we can hint user to do pip install apache-beam[gcp]; if the failed scheme is s3://, we can hint user to do pip install apache-beam[aws]; and so on

from beam.

@Abacn Thank you for reviewing my proposal. 👍

#31219 will cause excessive warning raised if user not intended to install these dependencies...

In my PR, there should not be any warning logs for modules ([gcp], [aws], etc.) that the user has not intended to installed. The import statement for not-installed modules should throw ModuleNotFoundError, so they should be blocked before the section on ImportError. (Am I right?)

$ python3
Python 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> try:
...   import this_is_module_not_found
... except ModuleNotFoundError:
...   print("ModuleNotFound!")
... except ImportError:
...   print("ImportError!")
... 
ModuleNotFound!
>>>

However, on the other hand:

Can we improve the error message you referred to in the description instead?

Even better, currently it hints ...

I think these ideas are excellent!

I was considering this issue under the scope of "when modules (gcp/aws/azure) installed by the user as Filesystem fail to initialize due to for some reason (such as OpenSSL)."
I think the enhancement you suggested(where the user has not installed Filesystem) could either be a separate issue or included in this one. (I would be happy to submit a PR! 👀)

from beam.