home / github / issues

Menu
  • Search all tables
  • GraphQL API

issues: 1520760951

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
1520760951 I_kwDOAMm_X85apPh3 7421 Opening a variable as several chunks works fine, but opening it "fully" crashes 8382834 closed 0     8 2023-01-05T13:36:42Z 2023-01-06T14:13:55Z 2023-01-06T14:13:55Z CONTRIBUTOR      

What happened?

I have set up a ipynb notebook that may be a clear explanation:

https://github.com/jerabaul29/misc/blob/main/BugReports/OpeningIssueXarray/issue_opening_2018_03_b.ipynb

Short report:

  • I have a netcdf file that is not specially big (around 1.6GB)
  • When I try to fully open one of its variables, it crashes, ie this crashes:

```

for some reason, this does not work; crash

xr_file["accD"][0, 0:3235893].data ```

but opening in several passes works, i.e. this works:

xr_file["accD"][0, 1000000:2000000].data xr_file["accD"][0, 2000000:3000000].data xr_file["accD"][0, 3000000:3235893].data

Any idea why?

What did you expect to happen?

Opening the variable in full should work.

Minimal Complete Verifiable Example

https://github.com/jerabaul29/misc/blob/main/BugReports/OpeningIssueXarray/issue_opening_2018_03_b.ipynb

MVCE confirmation

  • [x] Minimal example — the example is as focused as reasonably possible to demonstrate the underlying issue in xarray.
  • [x] Complete example — the example is self-contained, including all data and the text of any traceback.
  • [x] Verifiable example — the example copy & pastes into an IPython prompt or Binder notebook, returning the result.
  • [x] New issue — a search of GitHub Issues suggests this is not a duplicate.

Relevant log output

No response

Anything else we need to know?

The netcdf file uses unlimited dimensions, can this be a problem? I am not the author of the file, but I think it was generated from some Matlab netCDF package.

Environment

Ubuntu 20.04, python 3.8.10, xarray 0.20.2.

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/7421/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 2 rows from issues_id in issues_labels
  • 8 rows from issue in issue_comments
Powered by Datasette · Queries took 0.568ms · About: xarray-datasette