html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue
https://github.com/pydata/xarray/pull/7540#issuecomment-1460182260,https://api.github.com/repos/pydata/xarray/issues/7540,1460182260,IC_kwDOAMm_X85XCJz0,1197350,2023-03-08T13:48:51Z,2023-03-08T13:49:21Z,MEMBER,"Regarding locks, I think we need to think hard about the best way to deal with this across the stack. There are a couple of different options:
- Current status: just use a global lock on the entire array--super inefficient
- A bit better: use per-variable locks
- Even better: have locks at the shard level. This would allow concurrent writing of shards
- Alternative which accomplishes the same thing: expose different virtual chunks when reading vs. writing. When writing, the writer library (e.g. Xarray or Dask) would see the shards as the chunks (with a lower layer of the stack handling breaking the shard down into chunks). When reading, the individual, smaller chunks would be accessible.

Note that there are still some deep inefficiencies in the way zarr-python writes shards (see https://github.com/zarr-developers/zarr-python/discussions/1338). I think we should be optimizing things at the Zarr level first, before implementing workarounds in Xarray.","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,1588516592
https://github.com/pydata/xarray/pull/7540#issuecomment-1460175664,https://api.github.com/repos/pydata/xarray/issues/7540,1460175664,IC_kwDOAMm_X85XCIMw,1197350,2023-03-08T13:44:02Z,2023-03-08T13:44:02Z,MEMBER,"It's great to see this PR get started in Xarray! Thanks @JMorado!

From the perspective of a Zarr developer, the sharding feature is still highly experimental. The API may change significantly. While the sharding code is released in the sense that it is available deep in Zarr, it is not really considered part of the public API yet.

So perhaps it's a bit too early to be doing this?","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,1588516592