home / github

Menu
  • GraphQL API
  • Search all tables

issue_comments

Table actions
  • GraphQL API for issue_comments

13 rows where author_association = "MEMBER" and issue = 96211612 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: reactions, created_at (date), updated_at (date)

user 3

  • rabernat 5
  • shoyer 4
  • jhamman 4

issue 1

  • API for multi-dimensional resampling/regridding · 13 ✖

author_association 1

  • MEMBER · 13 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
349016244 https://github.com/pydata/xarray/issues/486#issuecomment-349016244 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDM0OTAxNjI0NA== shoyer 1217238 2017-12-04T16:27:51Z 2017-12-04T16:27:51Z MEMBER

For nearest-neighbor style resampling, we already have support for 1-dimensional resampling in .reindex()/.sel(). It would feel pretty natural to add support for N-dimensional resampling, too, if those lookups can use an index of some sort (i.e., a KDTree) to do things efficiently.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
348556569 https://github.com/pydata/xarray/issues/486#issuecomment-348556569 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDM0ODU1NjU2OQ== jhamman 2443309 2017-12-01T17:28:13Z 2017-12-01T17:28:13Z MEMBER

@mraspaud - What functionality are you interested in bringing over? I've been watching pyresample for a while and would love to see our two packages leverage each other's functionality (where possible).

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
348163073 https://github.com/pydata/xarray/issues/486#issuecomment-348163073 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDM0ODE2MzA3Mw== shoyer 1217238 2017-11-30T11:34:19Z 2017-11-30T11:34:19Z MEMBER

@mraspaud of pyresample expressed interest to me offline about bringing some of pyresample's resampling features into xarray -- welcome to the conversation!

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
325723036 https://github.com/pydata/xarray/issues/486#issuecomment-325723036 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDMyNTcyMzAzNg== rabernat 1197350 2017-08-29T16:42:07Z 2017-08-29T16:42:07Z MEMBER

Awesome work @JiaweiZhuang! This could be a great way forward for this important need. I think lots of us would be keen to contribute to your project. I encourage you to add tests and docs...that will help other contributors feel comfortable getting involved.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
272585787 https://github.com/pydata/xarray/issues/486#issuecomment-272585787 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDI3MjU4NTc4Nw== shoyer 1217238 2017-01-14T00:43:35Z 2017-01-14T00:43:35Z MEMBER

Is there a style guide that I can/should follow? Something like this: https://google.github.io/styleguide/pyguide.html? Does it or something else define naming conventions?

It's pretty standard to follow Python's PEP8 with NumPy-style docstrings.

I generally like the Google style guide, too, but it leans towards being overly strict -- sometimes it's OK to be more relaxed (e.g., it's rules for valid import statements). Also, the public facing version has gotten out of date (I think there are plans to update it).

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
271682285 https://github.com/pydata/xarray/issues/486#issuecomment-271682285 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDI3MTY4MjI4NQ== jhamman 2443309 2017-01-10T20:03:19Z 2017-01-10T20:03:19Z MEMBER

@rabernat - I've more or less settled that this belongs in a separate package that uses xarray's accessor features.

I've setup a little project (xmap) to get this started that I hope we can garner some volunteers to help push forward (nudge @godfrey4000 and @forman): https://github.com/jhamman/xmap

There will likely be some overlap between features that xmap and xarray. In those cases, we can try to push relevant features toward xarray.

{
    "total_count": 5,
    "+1": 5,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
271597986 https://github.com/pydata/xarray/issues/486#issuecomment-271597986 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDI3MTU5Nzk4Ng== rabernat 1197350 2017-01-10T15:02:40Z 2017-01-10T15:02:40Z MEMBER

@godfrey4000: lots of us in the climate community would like xarray-backed regridding. It is a hard problem, however. It wold be great if you wanted to work on it.

At a recent workshop, a group of xarray users developed a draft design document for a regridding package. https://aospy.hackpad.com/Regridding-Design-Document-tENJARIeg83

Your comments on this would be very welcome. An open question is whether the regridding belongs within xarray or in a standalone package (which would of course have xarray as a dependency).

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
207539263 https://github.com/pydata/xarray/issues/486#issuecomment-207539263 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDIwNzUzOTI2Mw== rabernat 1197350 2016-04-08T18:02:07Z 2016-04-08T18:02:07Z MEMBER

I feel like the biggest application of the multi-dimensional groupby will be with "conservative resampling" and coarse-graining, where you want to make sure to conserve certain integrals (e.g. total heat content) while changing coordinates.

pyresample will be more useful for fine-graining and interpolating missing data.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
207529535 https://github.com/pydata/xarray/issues/486#issuecomment-207529535 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDIwNzUyOTUzNQ== jhamman 2443309 2016-04-08T17:34:37Z 2016-04-08T17:34:37Z MEMBER

@forman - no progress on my end and no plans to work on this in the next 6 months. If your team is interested in working on this, we can discuss the api further and I'm happy to provide input and guidance along the way. One option is to wrap pyresample and possibly fill in some of the missing pieces in their api. I'd like to see a user interface that looks something like this:

python da.resample_like(other, kind='bilinear', dims=('lat', 'lon'))

As @rabernat mentions, for some remapping/resampling, the multi-dimensional groupby will help with some of these applications.

{
    "total_count": 3,
    "+1": 3,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
123413440 https://github.com/pydata/xarray/issues/486#issuecomment-123413440 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDEyMzQxMzQ0MA== jhamman 2443309 2015-07-21T17:45:51Z 2016-04-08T17:22:48Z MEMBER

I'd be interested in helping build a wrapper / api that supports the following types of regridding operations. I don't think pyresample handles all of these: 1. Bilinear interpolation 2. Bicubic interpolation 3. Distance-weighted average remapping 4. Nearest neighbor remapping 5. Conservative (area) remapping 6. Largest area fraction remapping

I would also like to see some better support for 2D coordinate variables. These are specifically outlined in the cf-conventions in section: 5.2. Two-Dimensional Latitude, Longitude, Coordinate Variables. Maybe we can open an additional issue for that...

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
207385461 https://github.com/pydata/xarray/issues/486#issuecomment-207385461 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDIwNzM4NTQ2MQ== rabernat 1197350 2016-04-08T11:20:26Z 2016-04-08T11:20:26Z MEMBER

@forman I am starting to suspect that this might be possible to implement through #818

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
123405417 https://github.com/pydata/xarray/issues/486#issuecomment-123405417 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDEyMzQwNTQxNw== shoyer 1217238 2015-07-21T17:10:34Z 2015-07-21T17:10:34Z MEMBER

Indeed, SciPy's ndimage.interpolation.zoom would probably be more appropriate (and faster) for regular grids.

Xray currently doesn't have any built-in support for handling projected data, but basic selection and regridding (from explicit arrays of 2D coordinates) seems in scope for the project.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612
123305768 https://github.com/pydata/xarray/issues/486#issuecomment-123305768 https://api.github.com/repos/pydata/xarray/issues/486 MDEyOklzc3VlQ29tbWVudDEyMzMwNTc2OA== rabernat 1197350 2015-07-21T13:35:29Z 2015-07-21T13:36:32Z MEMBER

Pyresample is probably overkill for that case. Aggregating / decimating regular lat-lon grids could probably be done much more simply. For example

python N = 10 fac = 2 x = np.arange(N, dtype=np.float64) np.add.reduceat(x, np.arange(0,N,fac)) / fac

This gives array([ 0.5, 2.5, 4.5, 6.5, 8.5])

This type of resampling has the advantage of preserving certain integral invariants, as opposed to the nearest neighbor resampling in the example above. (Imagine if there had been lots of spatial variance below the 5 degree scale in that example--it would have been aliased horribly. That was only avoided because the original field was very smooth.) It is also very fast.

Pyresample seems best for complicated transformations from one map projection to another. I'm not sure I fully understand how xray handles grids where the coordinates are themselves 2d fields, as in this example.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  API for multi-dimensional resampling/regridding 96211612

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);
Powered by Datasette · Queries took 14.762ms · About: xarray-datasette