home / github / issue_comments

Menu
  • Search all tables
  • GraphQL API

issue_comments: 510169853

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/2501#issuecomment-510169853 https://api.github.com/repos/pydata/xarray/issues/2501 510169853 MDEyOklzc3VlQ29tbWVudDUxMDE2OTg1Mw== 1197350 2019-07-10T18:10:37Z 2019-07-10T18:10:37Z MEMBER

I believe that the memory issue is basically the same as https://github.com/dask/distributed/issues/2602.

The graphs look like: read --> rechunk --> write.

Reading and rechunking increase memory consumption. Writing relieves it. In Rich's case, the workers just load too much data before they write it. Eventually they run out of memory.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  372848074
Powered by Datasette · Queries took 0.718ms · About: xarray-datasette