home / github

Menu
  • Search all tables
  • GraphQL API

issue_comments

Table actions
  • GraphQL API for issue_comments

6 rows where author_association = "NONE" and user = 5797727 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: issue_url, reactions, created_at (date), updated_at (date)

issue 5

  • ValueError: unrecognized engine zarr must be one of: ['netcdf4', 'scipy', 'store'] 2
  • Problem opening unstructured grid ocean forecasts with 4D vertical coordinates 1
  • Pass `locator` argument to matplotlib when calling `plot.contourf` 1
  • `plot.scatter` only works for declared arguments 1
  • `OSError: [Errno -70] NetCDF: DAP server error` when `parallel=True` on a cluster 1

user 1

  • iuryt · 6 ✖

author_association 1

  • NONE · 6 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
1439056693 https://github.com/pydata/xarray/issues/7542#issuecomment-1439056693 https://api.github.com/repos/pydata/xarray/issues/7542 IC_kwDOAMm_X85VxkM1 iuryt 5797727 2023-02-21T20:33:29Z 2023-02-21T20:33:29Z NONE

It might be related to the issue, but the code below is for a different GES DISC dataset from a different server goldsmr5 and the code also break for parallel=True. The same code works well for parallel=False.

```python import xarray as xr import pandas as pd

list daily timestamps from a starting date to an end date

dts = pd.date_range(start = "2013-01-01", end = "2022-12-01", freq = "D")

base url for the files

base = "https://goldsmr5.gesdisc.eosdis.nasa.gov/opendap/MERRA2/M2I3NPASM.5.12.4/"

prefix of the files

prefix = "MERRA2_400.inst3_3d_asm_Np"

function to construct the url of the files

url = lambda d: f"{base}{d.year}/{d.month:02d}/{prefix}.{d.year}{d.month:02d}{d.day:02d}.nc4"

list of urls for the files

fnames = [url(dti) for dti in dts]

lets try to load the first 5 files

ds = xr.open_mfdataset(fnames[:5], parallel=True) ```

The error:

python OSError: [Errno -51] NetCDF: Unknown file format: b'https://goldsmr5.gesdisc.eosdis.nasa.gov/opendap/MERRA2/M2I3NPASM.5.12.4/2013/01/MERRA2_400.inst3_3d_asm_Np.20130105.nc4'

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `OSError: [Errno -70] NetCDF: DAP server error` when `parallel=True` on a cluster 1592154849
1372882600 https://github.com/pydata/xarray/issues/7422#issuecomment-1372882600 https://api.github.com/repos/pydata/xarray/issues/7422 IC_kwDOAMm_X85R1Iao iuryt 5797727 2023-01-05T22:39:22Z 2023-01-05T22:39:22Z NONE

Ok, that makes sense. I suspected that that was the case, but wanted to create an issue just in case. I think that we can close this now.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  `plot.scatter` only works for declared arguments 1521002414
1066784566 https://github.com/pydata/xarray/issues/2233#issuecomment-1066784566 https://api.github.com/repos/pydata/xarray/issues/2233 IC_kwDOAMm_X84_ldc2 iuryt 5797727 2022-03-14T13:27:00Z 2022-03-14T13:30:24Z NONE

Hi

For now, I found a workaround loading and renaming the problematic coordinates with netCDF4.Dataset(). Soon I will post this and other solutions for this model output in iuryt/FVCOMpy.

For now, you could try: ``` import xarray as xr from netCDF4 import Dataset

define year and month to be read

year = 2019 month = 5

we could use this to run a loop through the years/months we need

list problematic coordinates

drop_variables = ['siglay','siglev']

base url for openDAP server

url = "".join(["http://www.smast.umassd.edu:8080/thredds/dodsC/models/fvcom/", f"NECOFS/Archive/NECOFS_GOM/{year}/gom4_{year}{month:02d}.nc?"])

lazy load of the data

ds = xr.open_dataset(url,drop_variables=drop_variables,decode_times=False)

load data with netCDF4

nc = Dataset(url)

load the problematic coordinates

coords = {name:nc[name] for name in drop_variables}

function to extract ncattrs from Dataset()

get_attrs = lambda name: {attr:coords[name].getncattr(attr) for attr in coords[name].ncattrs()}

function to convert from Dataset() to xr.DataArray()

nc2xr = lambda name: xr.DataArray(coords[name],attrs=get_attrs(name),name=f'{name}_coord',dims=(f'{name}','node'))

merge xr.DataArray() objects

coords = xr.merge([nc2xr(name) for name in coords.keys()])

reassign to the main xr.Dataset()

ds = ds.assign_coords(coords) ```

Leaving it here in case someone fall into the same problem.

{
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Problem opening unstructured grid ocean forecasts with 4D vertical coordinates 332471780
850486324 https://github.com/pydata/xarray/issues/5395#issuecomment-850486324 https://api.github.com/repos/pydata/xarray/issues/5395 MDEyOklzc3VlQ29tbWVudDg1MDQ4NjMyNA== iuryt 5797727 2021-05-28T15:09:30Z 2021-05-28T15:09:30Z NONE

actually, did you try !pip install xarray[complete]?

That worked! Thanks!

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  ValueError: unrecognized engine zarr must be one of: ['netcdf4', 'scipy', 'store'] 905452377
850471202 https://github.com/pydata/xarray/issues/5395#issuecomment-850471202 https://api.github.com/repos/pydata/xarray/issues/5395 MDEyOklzc3VlQ29tbWVudDg1MDQ3MTIwMg== iuryt 5797727 2021-05-28T14:46:11Z 2021-05-28T14:46:11Z NONE

As I am using Google Colab I simply installed zarr and xarray using pip (as they suggest) and tried to run the command. python !pip install zarr xarray

Maybe this is something with the way Colab setup things, but it would be nice to have a way to make it work. I am planning to use it in a course and Colab helps to save time on the installing process.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  ValueError: unrecognized engine zarr must be one of: ['netcdf4', 'scipy', 'store'] 905452377
757511341 https://github.com/pydata/xarray/issues/4787#issuecomment-757511341 https://api.github.com/repos/pydata/xarray/issues/4787 MDEyOklzc3VlQ29tbWVudDc1NzUxMTM0MQ== iuryt 5797727 2021-01-10T17:20:21Z 2021-01-10T17:20:21Z NONE

I can tackle this one, if no one does that before, I just have to separate a time in my week schedule for open-source projects.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Pass `locator` argument to matplotlib when calling `plot.contourf` 782848816

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);
Powered by Datasette · Queries took 16.501ms · About: xarray-datasette