TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' about adlfs HOT 6 CLOSED

(about the cache: I am wondering if this comes from caching somehow, as I run the exact same code earlier today, and it worked; it stopped working after the remote blob was updated).

from adlfs.

(and I am pretty sure the file is valid and well found, if I try a different non existing filename I get a much more understandable error FileNotFoundError, so it seems that the file does is found)

from adlfs.

Unfortunately, this is on a private store, so I cannot share access for debugging :( .

from adlfs.

That may come from using an older version:

[ins] In [1]: import adlfs

[ins] In [2]: adlfs.__version__
Out[2]: '2023.1.0'

I will update to latest and check if the issue persists.

from adlfs.

I have i) updated to the newest version, ii) disabled cache when reading the small "volatile" json files I was having issues with, by changing my code to:

    # It seems that adlfs does not handle "files that change" too
    # well due to using (not very smart / robust) caching: there
    # were some issues during testing when the *.json files
    # changed "on the fly".
    # To avoid issues with cache, disable it (we are reading small
    # "volatile" json files anyways), and put it in an area where
    # it is easy to find and inspect in case of issues.
    az_fs = AzureBlobFileSystem(
        use_listings_cache=False,
        # cache_storage='/tmp/fsspec_cache/',
        **zarr_credentials["storage_options"]
    )

    with az_fs.open(json_az_path, "r") as json_fh:
        json_content = json_fh.read()
        dict_json = json.loads(json_content)
        print(f"read json manifest {json_az_path} | content: {json_content}")

from adlfs.

Closing for now, will re-open if the issue shows up again.

from adlfs.