home / github / issues

Menu
  • GraphQL API
  • Search all tables

issues: 255897797

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
255897797 MDU6SXNzdWUyNTU4OTc3OTc= 1559 Subsetting not reducing memory consumption with mfdataset on Windows 761677 closed 0     5 2017-09-07T10:58:30Z 2017-09-14T09:51:51Z 2017-09-14T09:51:51Z NONE      

On Windows, with the following code I run out of memory: d = xr.open_mfdataset(filepath) sed = d.sediment_mass_per_unit_area.isel(time=-1) sed.load() d.close() but when using "open_dataset" I load the data instantly: d = xr.open_dataset(filepath) sed = d.sediment_mass_per_unit_area.isel(time=-1) sed.load() d.close() On linux both methods use minimal memory. The target file is 1.5 GB, and the target variable is 1460x862x900 floats. Filepath is a single file, not multiple files. Xarray 0.9.6 used on both systems, installed with conda.

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/1559/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 0 rows from issues_id in issues_labels
  • 5 rows from issue in issue_comments
Powered by Datasette · Queries took 0.559ms · About: xarray-datasette