home / github / commits

Menu
  • Search all tables
  • GraphQL API

commits: 851dadeb0338403e5021c3fbe80cbc9127ee672d

This data as json

sha message author_date committer_date raw_author raw_committer repo author committer
851dadeb0338403e5021c3fbe80cbc9127ee672d No chunk warning if empty (#6402) * Test with warning when loading Zarr with empty dimension with chunks If an array has zero size (due to an empty dimension), it is saved as a single chunk regardless of Dask chunking on other dimensions (#5742). If the `chunks` parameter is provided for other dimensions when loading the Zarr file, xarray gives a warning about potentially degraded performance from splitting the single chunk. When the array has zero size, this warning seems inappropriate because: - performance degradation on an empty array should be negligible. - we don't always know if one of the dimensions is empty until loading. I would use the `chunks` parameter for dimensions that have known chunksize (to specify some multiple of that chunksize), but this only works without warning when the array is nonempty. * Don't check chunk compatibility if variable is empty/has no size * Docs describing removal of warning for `chunks` with empty array Co-authored-by: Deepak Cherian <dcherian@users.noreply.github.com> Co-authored-by: Maximilian Roos <5635139+max-sixty@users.noreply.github.com> 2022-04-09T20:27:39Z 2022-04-09T20:27:39Z 8e3ae398883b443a2f202292cd29e75d1cbcf011 cd792325681cbad9f663f2879d8b69f1edbb678f 13221727 4666753 19864447
Powered by Datasette · Queries took 0.721ms · About: xarray-datasette