home / github / issue_comments

Menu
  • Search all tables
  • GraphQL API

issue_comments: 233998757

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/912#issuecomment-233998757 https://api.github.com/repos/pydata/xarray/issues/912 233998757 MDEyOklzc3VlQ29tbWVudDIzMzk5ODc1Nw== 1217238 2016-07-20T16:11:27Z 2016-07-20T16:11:27Z MEMBER

When you write ds.conc_profs.chunk(2400), it sets up the data to be loaded in a giant chunk, almost the entire file at once. Even if you use .isel() afterwards, dask does not always manage to subset the data from the initial chunk. (Sometimes it does succeed, which makes this a little confusing.)

You will probably be more successful if you try something like ds.conc_profs.chunk({'burst': 10}) instead, which keeps the intermediate chunks to a reasonable size.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  166593563
Powered by Datasette · Queries took 0.852ms · About: xarray-datasette