home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 472129555

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/2807#issuecomment-472129555 https://api.github.com/repos/pydata/xarray/issues/2807 472129555 MDEyOklzc3VlQ29tbWVudDQ3MjEyOTU1NQ== 1217238 2019-03-12T18:37:03Z 2019-03-12T18:37:03Z MEMBER

In the first version of apply_ufunc, I experimented with applying functions that take and return xarray objects.

The challenge is that with dask's lazy evaluation, we don't know the structure of the returned objects until after evaluating the wrapped functions. So we can't rebuild xarray objects unless we require redundantly specify all the coordinates and attributes from the return values.

The alternative would be to make a parallel but eagerly evaluated version of apply_ufunc, e.g., by calling compute on each chunk and then reassembling the result (e.g., ttps://github.com/pydata/xarray/pull/2616). The downside is that this will load your data into memory, but maybe that's acceptable for your purposes.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  420139027
Powered by Datasette · Queries took 0.681ms · About: xarray-datasette