home / github / issues

Menu
  • Search all tables
  • GraphQL API

issues: 843996137

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
843996137 MDU6SXNzdWU4NDM5OTYxMzc= 5092 Concurrent loading of coordinate arrays from Zarr 1217238 open 0     0 2021-03-30T02:19:50Z 2021-04-19T02:43:31Z   MEMBER      

When you open a dataset with Zarr, xarray loads coordinate arrays corresponding to indexes in serial. This can be slow (multiple seconds) even with only a handful of such arrays if they are stored in a remote filesystem (e.g., cloud object stores). This is similar to the use-cases for consolidated metadata.

In principle, we could speed up loading datasets from Zarr into Xarray significantly by reading the data corresponding to these arrays in parallel (e.g., in multiple threads).

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/5092/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
    13221727 issue

Links from other tables

  • 2 rows from issues_id in issues_labels
  • 0 rows from issue in issue_comments
Powered by Datasette · Queries took 157.281ms · About: xarray-datasette