issues: 284607311

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
284607311 MDExOlB1bGxSZXF1ZXN0MTYwMTY1NjI3 1800 WIP: Performance improvements for zarr backend 2443309 closed 0   3008859 6 2017-12-26T20:37:45Z 2018-01-24T14:56:57Z 2018-01-24T14:55:52Z MEMBER   0 pydata/xarray/pulls/1800
  • [x] Closes #https://github.com/pangeo-data/pangeo/issues/48
  • [x] Tests added (for all bug fixes or enhancements)
  • [x] Tests passed (for all non-documentation changes)
  • [x] Passes git diff upstream/master **/*py | flake8 --diff (remove if you did not edit any Python files)
  • [x] Fully documented, including whats-new.rst for all changes and api.rst for new API (remove if this change should not be visible to users, e.g., if it is an internal clean-up, or if this is part of a larger project that will be documented later)

This is building on top of #1799. Based on the suggestion from @alimanfoo in https://github.com/pangeo-data/pangeo/issues/48#issuecomment-353807691, I have reworked the handling of attributes in the zarr backend. There is more to do here, particularly in the set_dimensions arena but this is giving almost a 2x speedup in writing to GCP.

cc @rabernat, @mrocklin and @alimanfoo

 
{
    "url": "https://api.github.com/repos/pydata/xarray/issues/1800/reactions",
    "total_count": 1,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 1,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
     13221727 pull

Links from other tables