home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 867715379

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/5511#issuecomment-867715379 https://api.github.com/repos/pydata/xarray/issues/5511 867715379 MDEyOklzc3VlQ29tbWVudDg2NzcxNTM3OQ== 25071375 2021-06-24T15:08:47Z 2021-06-24T15:08:47Z CONTRIBUTOR

Hi, (sorry if this sound annoying) I check a little bit the code used to append data to Zarr files, and from my perspective the logic is correct and it takes into account the case where the last chunks have differents shape because it works with the shape of the unmodified array and then it resizes it to write in regions with Dask:

I ran the same code that I let in the previous comment but I passed a synchronizer to the 'to_zarr' method (synchronizer=zarr.ThreadSynchronizer()) and all the problems related to the nans and to PermissonErrors disappeared, so this looks more like a synchronization problem between Zarr and Dask.

Hope this helps in something to fix the bug.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  927617256
Powered by Datasette · Queries took 0.653ms · About: xarray-datasette