home / github / issues

Menu
  • GraphQL API
  • Search all tables

issues: 523041080

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
523041080 MDU6SXNzdWU1MjMwNDEwODA= 3536 Update dataset attributes and sync to disk store 3780274 open 0     1 2019-11-14T18:52:05Z 2023-09-21T23:09:18Z   NONE      

Summary: I would like to be able to update dataset/dataarray attributes and sync the updates to disk.

Regarding the Zarr backend in Xarray, at the moment once datasets are read from disk all modifications are in memory only. This means that for the particular case of metadata stored as attributes, in order to update an attribute on disk there are two choices:

  • Assign the new attribute to the dataset and write the whole dataset again to disk.
  • Use Zarr directly to access the dataset attributes and perform an 'attribute sync'.

The former is prohibitive , in particular for large datasets, but in general it is not a good practice that in order to modify one attribute I need to rewrite the whole pixel data.

The second is possible, and certainly I could imagine the need to write a custom function to do this. Is that something that should be available in the xarray library though? Something like ds.sync_attributes() that updates the attributes on disk?

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/3536/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
    13221727 issue

Links from other tables

  • 1 row from issues_id in issues_labels
  • 0 rows from issue in issue_comments
Powered by Datasette · Queries took 84.813ms · About: xarray-datasette