home / github

Menu
  • Search all tables
  • GraphQL API

issue_comments

Table actions
  • GraphQL API for issue_comments

7 rows where author_association = "CONTRIBUTOR" and issue = 89268800 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 3

  • guziy 4
  • j08lue 2
  • spencerahill 1

issue 1

  • `xray.open_mfdataset` concatenates also variables without time dimension · 7 ✖

author_association 1

  • CONTRIBUTOR · 7 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
330592365 https://github.com/pydata/xarray/issues/438#issuecomment-330592365 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDMzMDU5MjM2NQ== guziy 900941 2017-09-19T16:16:57Z 2017-09-19T16:16:57Z CONTRIBUTOR

Thanks @shoyer: Is there a how to contribute guide? I basically look for how to write a test and run test to check if my adding this option did not break anything...

Cheers

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
330580615 https://github.com/pydata/xarray/issues/438#issuecomment-330580615 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDMzMDU4MDYxNQ== guziy 900941 2017-09-19T15:39:53Z 2017-09-19T15:40:40Z CONTRIBUTOR

This seems to be working, and no deprecation warning... (But probably I have to sort paths...)

```python In [8]: ds = xarray.concat([xarray.open_dataset(p, chunks={"time": 100}) for p in paths], data_vars="minimal", dim="time")

In [9]: ds Out[9]: <xarray.Dataset> Dimensions: (time: 13505, x: 782, y: 808) Coordinates: * x (x) float64 -4.556e+06 -4.546e+06 -4.536e+06 ... * y (y) float64 4.98e+06 4.97e+06 4.96e+06 4.95e+06 ... * time (time) datetime64[ns] 1993-01-01T12:00:09.140797440 ... Data variables: lon (y, x) float64 156.5 156.5 156.6 156.6 156.7 ... lat (y, x) float64 58.55 58.64 58.72 58.81 58.9 ... lambert_conformal_conic int16 -32767 tmin (time, y, x) float64 nan nan nan nan nan nan ...

In [10]: lon = ds["lon"]

In [11]: lon.ndim Out[11]: 2 ``` Cheers

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
330569786 https://github.com/pydata/xarray/issues/438#issuecomment-330569786 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDMzMDU2OTc4Ng== guziy 900941 2017-09-19T15:05:27Z 2017-09-19T15:05:49Z CONTRIBUTOR

Thanks @spencerahill : You are right, but the error message won't change, since the data_vars keyword is not known, and I am not able to change the dataset's attribute data_vars. I think I have to use concat explicitly...

Cheers

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
330568482 https://github.com/pydata/xarray/issues/438#issuecomment-330568482 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDMzMDU2ODQ4Mg== spencerahill 6200806 2017-09-19T15:01:37Z 2017-09-19T15:01:37Z CONTRIBUTOR

I think you've accidentally used "minimum" instead of "minimal"

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
330567549 https://github.com/pydata/xarray/issues/438#issuecomment-330567549 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDMzMDU2NzU0OQ== guziy 900941 2017-09-19T14:58:55Z 2017-09-19T14:58:55Z CONTRIBUTOR

Hi @shoyer:

where is this data_vars='minimal' set? or maybe I am using a wrong version of xarray? Here is what I get

```python

In [10]: ds = xarray.open_mfdataset("/snow3/huziy/Daymet_daily_derivatives/daymet_spatial_agg_tmin_10x10/daymet_v3_tmin_*.nc4", data_vars="minimum")

TypeError Traceback (most recent call last) <ipython-input-10-ba844206f74a> in <module>() ----> 1 ds = xarray.open_mfdataset("/snow3/huziy/Daymet_daily_derivatives/daymet_spatial_agg_tmin_10x10/daymet_v3_tmin_*.nc4", data_vars="minimum")

/snow3/huziy/Python/python_builds/anaconda3/envs/py3.6-a3/lib/python3.6/site-packages/xarray/backends/api.py in open_mfdataset(paths, chunks, concat_dim, compat, preprocess, engine, lock, **kwargs) 503 paths = sorted(glob(paths)) 504 else: --> 505 paths = [str(p) if isinstance(p, path_type) else p for p in paths] 506 507 if not paths:

/snow3/huziy/Python/python_builds/anaconda3/envs/py3.6-a3/lib/python3.6/site-packages/xarray/backends/api.py in <listcomp>(.0) 503 paths = sorted(glob(paths)) 504 else: --> 505 paths = [str(p) if isinstance(p, path_type) else p for p in paths] 506 507 if not paths:

TypeError: open_dataset() got an unexpected keyword argument 'data_vars'

In [11]: ds = xarray.open_mfdataset("/snow3/huziy/Daymet_daily_derivatives/daymet_spatial_agg_tmin_10x10/daymet_v3_tmin_*.nc4")

In [12]: ds.data_vars = "minimum"

AttributeError Traceback (most recent call last) <ipython-input-12-9026b067946d> in <module>() ----> 1 ds.data_vars = "minimum"

/snow3/huziy/Python/python_builds/anaconda3/envs/py3.6-a3/lib/python3.6/site-packages/xarray/core/common.py in setattr(self, name, value) 180 raise AttributeError( 181 "cannot set attribute %r on a %r object. Use setitem " --> 182 "style assignment (e.g., ds['name'] = ...) instead to " 183 "assign variables." % (name, type(self).name)) 184 object.setattr(self, name, value)

AttributeError: can't set attribute

In [13]: ds.data_vars Out[13]: Data variables: tmin (time, y, x) float64 nan nan nan nan nan nan ... lon (time, y, x) float64 156.5 156.5 156.6 156.6 ... lat (time, y, x) float64 58.55 58.64 58.72 58.81 ... lambert_conformal_conic (time) int64 -32767 -32767 -32767 -32767 -32767 ...

In [16]: xarray.version Out[16]: '0.9.6'

``` Cheers

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
113422235 https://github.com/pydata/xarray/issues/438#issuecomment-113422235 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDExMzQyMjIzNQ== j08lue 3404817 2015-06-19T08:03:19Z 2015-06-19T08:03:44Z CONTRIBUTOR

netCDF4-python uses a dimension specified by the user or an unlimited dimension it finds in the dataset. Here is the corresponding code section.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800
113415070 https://github.com/pydata/xarray/issues/438#issuecomment-113415070 https://api.github.com/repos/pydata/xarray/issues/438 MDEyOklzc3VlQ29tbWVudDExMzQxNTA3MA== j08lue 3404817 2015-06-19T07:44:25Z 2015-06-19T07:45:40Z CONTRIBUTOR

Here is a print-out of the full dataset for POP ocean model output (see that gist in nbviewer).

I can see that the heuristics exclude variables from concatenation that are associated with dimensions of other variables. But why not just exclude all that do not have a time dimension?

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `xray.open_mfdataset` concatenates also variables without time dimension 89268800

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);
Powered by Datasette · Queries took 14.246ms · About: xarray-datasette