home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 362673882

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/pull/1793#issuecomment-362673882 https://api.github.com/repos/pydata/xarray/issues/1793 362673882 MDEyOklzc3VlQ29tbWVudDM2MjY3Mzg4Mg== 1217238 2018-02-02T18:57:33Z 2018-02-02T18:57:33Z MEMBER

We might always need to use autoclose=True with distributed. The problem is that in xarray's default mode of operation, we open a netCDF file (without using dask) to create variables, dimensions and attributes, keeping the file open. Then we write the data using dask (via AbstractWritableDataStore.sync()), but the original file is still open.

As for the lock, we need locking both: - Per process: only one thread can use HDF5 for reading/writing at the same time. - Per file: only one worker can read/write a file at the same time.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  283388962
Powered by Datasette · Queries took 0.768ms · About: xarray-datasette