home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 516193582

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/3165#issuecomment-516193582 https://api.github.com/repos/pydata/xarray/issues/3165 516193582 MDEyOklzc3VlQ29tbWVudDUxNjE5MzU4Mg== 1217238 2019-07-29T22:59:48Z 2019-07-29T22:59:48Z MEMBER

For context, xarray's rolling window code creates a "virtual dimension" for the rolling window. So if your chunks are size (5000, 100) before the rolling window, they are size (5000, 100, 100) within the rolling window computation. So it's not entirely surprising that there are more issues with memory usage -- these are much bigger arrays, e.g., see ```

temp.rolling(x=100).construct('window') <xarray.DataArray (x: 5000, y: 50000, window: 100)> dask.array<shape=(5000, 50000, 100), dtype=float64, chunksize=(50, 100, 100)> Dimensions without coordinates: x, y, window ```

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  473692721
Powered by Datasette · Queries took 0.679ms · About: xarray-datasette