issues: 201617371
This data as json
id | node_id | number | title | user | state | locked | assignee | milestone | comments | created_at | updated_at | closed_at | author_association | active_lock_reason | draft | pull_request | body | reactions | performed_via_github_app | state_reason | repo | type |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
201617371 | MDU6SXNzdWUyMDE2MTczNzE= | 1217 | Using where() in datasets with dataarrays with different dimensions results in huge RAM consumption | 4849151 | closed | 0 | 6 | 2017-01-18T16:09:50Z | 2019-02-23T07:47:01Z | 2019-02-23T07:47:01Z | NONE | I have a dataset containing groups of data with different dimensions. e.g.:
If I do something like ds.where(ds.data1 < 0.1), Python ends up allocating huge amounts of memory (>30GB for a dataset of <1MB) and seems to loop indefinitely, until the call is interrupted with CTRL-C. To use where() successfully, I have to use a subset of the dataset with only one dimension. |
{ "url": "https://api.github.com/repos/pydata/xarray/issues/1217/reactions", "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
completed | 13221727 | issue |