home / github / issues

Menu
  • GraphQL API
  • Search all tables

issues: 94030797

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
94030797 MDU6SXNzdWU5NDAzMDc5Nw== 458 groupby / apply and dask (`open_mfdataset`) 1177508 closed 0     2 2015-07-09T12:10:04Z 2015-07-15T00:02:40Z 2015-07-15T00:02:34Z NONE      

It seems that, when working with open_mfdataset, things are not consistent. Trying the following:

python import numpy as np import xray a = xray.open_mfdataset('*.nc', concat_dim='time', preprocess=lambda x: x.assign_coords(agl=('mean_height_agl', range(x.dims['mean_height_agl']))).swap_dims({'mean_height_agl': 'agl'}).squeeze('time')) a.groupby('time').apply(np.sum)

gives an error with a huge traceback that ends with:

``` python IndexError: Exception in remote process

tuple index out of range

Traceback: File "/home/razvan/.local/lib/python3.4/site-packages/dask/async.py", line 260, in execute_task result = _execute_task(task, data) File "/home/razvan/.local/lib/python3.4/site-packages/dask/async.py", line 243, in _execute_task return func(*args2) File "/home/razvan/.local/lib/python3.4/site-packages/toolz/functoolz.py", line 378, in call ret = fns0 File "/home/razvan/.local/lib/python3.4/site-packages/dask/array/core.py", line 377, in _concatenate2 ```

but if I do:

python a.load() a.groupby('time').apply(np.sum)

there's no error. The files I'm using for this are at this dropbox place.

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/458/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 2 rows from issues_id in issues_labels
  • 2 rows from issue in issue_comments
Powered by Datasette · Queries took 0.634ms · About: xarray-datasette