issues: 593825520
This data as json
| id | node_id | number | title | user | state | locked | assignee | milestone | comments | created_at | updated_at | closed_at | author_association | active_lock_reason | draft | pull_request | body | reactions | performed_via_github_app | state_reason | repo | type |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 593825520 | MDU6SXNzdWU1OTM4MjU1MjA= | 3932 | Element wise dataArray generation | 11750960 | closed | 0 | 6 | 2020-04-04T12:24:16Z | 2020-04-07T04:32:12Z | 2020-04-07T04:32:12Z | CONTRIBUTOR | I'm in a situation where I want to generate a bidimensional DataArray from a method that takes each of the two dimensions as input parameters. I have two methods to do this but neither of these looks particularly elegant to me and I wondered whether somebody would have better ideas.
``` x = np.arange(10) y = np.arange(20) some_exp = lambda x, y: np.ones((Nstats)) some_exp_delayed = dask.delayed(some_exp, pure=True) lazy_data = [some_exp_delayed(_x, _y) for _x in x for _y in y] sample = lazy_data[0].compute() arrays = [da.from_delayed(lazy_value, dtype=sample.dtype, shape=sample.shape) for lazy_value in lazy_data] stack = (da.stack(arrays, axis=0) .reshape((len(x),len(y),sample.size)) ) ds = xr.DataArray(stack, dims=['x','y','stats']) ``` I tend to prefer this option because it imposes less requirement on the
``` x = np.arange(10) y = np.arange(20) ds = xr.Dataset(coords={'x': x, 'y': y}) ds['_y'] = (0*ds.x+ds.y) # breaks apply_ufunc otherwise ds = ds.chunk({'x': 1, 'y':1}) let's say each experiment outputs 5 statistical diagnosticsNstats = 5 some_exp = lambda x, y: np.ones((1,1,Nstats)) out = (xr.apply_ufunc(some_exp, ds.x, ds._y,
dask='parallelized',
output_dtypes=[float],
output_sizes={'stats': Nstats},
output_core_dims=[['stats']])
)
|
{
"url": "https://api.github.com/repos/pydata/xarray/issues/3932/reactions",
"total_count": 0,
"+1": 0,
"-1": 0,
"laugh": 0,
"hooray": 0,
"confused": 0,
"heart": 0,
"rocket": 0,
"eyes": 0
} |
completed | 13221727 | issue |