home / github / issue_comments

Menu
  • Search all tables
  • GraphQL API

issue_comments: 1286028393

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/6807#issuecomment-1286028393 https://api.github.com/repos/pydata/xarray/issues/6807 1286028393 IC_kwDOAMm_X85Mpzxp 35968931 2022-10-20T19:22:11Z 2022-10-20T19:22:11Z MEMBER

@rabernat just pointed out to me that in order for this to work well we might also need lazy concatenation of arrays.

Xarray currently has it's own internal wrappers that allow lazy indexing, but they don't yet allow lazy concatenation. Instead dask is what does lazy concatenation under the hood right now.

This is a problem - it means that concatenating two cubed-backed DataArrays will trigger loading both into memory, whereas concatenating two dask-backed DataArrays will not. If #4628 was implemented then xarray would never load the underlying array into memory regardless of the backend.

{
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  1308715638
Powered by Datasette · Queries took 0.895ms · About: xarray-datasette