issues: 833518574
This data as json
id | node_id | number | title | user | state | locked | assignee | milestone | comments | created_at | updated_at | closed_at | author_association | active_lock_reason | draft | pull_request | body | reactions | performed_via_github_app | state_reason | repo | type |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
833518574 | MDU6SXNzdWU4MzM1MTg1NzQ= | 5043 | open_mfdataset failed to open tarfile filestream when it locates in the context of dask.distributed Client | 12339722 | open | 0 | 1 | 2021-03-17T08:17:47Z | 2021-06-20T21:06:23Z | NONE | Recently, i use My code is like following, ```python import tarfile from dask.distributed import Client client = Client() tar = tarfile.open(my_multiple_netcdf_tar_gz_file) flist = [tar.extractfile(member) for member in tar.getmembers()] ds = xr.open_mfdataset(flist) This line will raise Exceptionprint(ds.MyNcVar.values) ....blah blah my other client calcualation codes....client.close() ``` In above code, the elements of variable The reason is We can see in this line of ```python # Notes this line will force chunks=None into chunks={} and result in the involvement of dask open_kwargs = dict(engine=engine, chunks=chunks or {}, **kwargs)
``` Even if i set the chunks=None, it will be a error cause the I think maybe we can keep the chunks value and if anyone want change it,
he or she can set it to
Or may you have a better solution for my problem ? Also, Thank You for your great jobs on this excellent package. |
{ "url": "https://api.github.com/repos/pydata/xarray/issues/5043/reactions", "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
13221727 | issue |