The range specified is invalid for the current size of the resource file when file is not empty about adlfs HOT 1 OPEN

I have an update, I was able to isolate the problem, and the real issue is the fsspec cache behavior, so I was able to use the following workaround using the option default_cache_type and default_fill_cache:

storage_options = {'account_name': account_name,  
    'account_key': account_key, 
    'default_cache_type':None, 
    'default_fill_cache': False, 
    'skip_instance_cache': True}
df = pd.read_csv(f"az://path/that/changed/on/another/python/session.csv", storage_options=storage_options,)

Leaving the issue open to check if this behavior is expected or if anyone has better ideas to handle this kind of situation.

from adlfs.