issue_comments

Table actions

5 rows where issue = 631085856 and user = 44142765 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 1

  • zoj613 · 5 ✖

issue 1

  • Document writing netcdf from xarray directly to S3 · 5 ✖

author_association 1

id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
1453906696 https://github.com/pydata/xarray/issues/4122#issuecomment-1453906696 https://api.github.com/repos/pydata/xarray/issues/4122 IC_kwDOAMm_X85WqNsI zoj613 44142765 2023-03-03T18:08:07Z 2023-03-03T18:08:07Z NONE

Based on the docs

The default format is NETCDF4 if you are saving a file to disk and have the netCDF4-python library available. Otherwise, xarray falls back to using scipy to write netCDF files and defaults to the NETCDF3_64BIT format (scipy does not support netCDF4).

It appears scipy engine is safe is one does not need to be bothered with specifying engines.By the way, what are the limitations of the netcdf3 standard vs netcdf4?

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Document writing netcdf from xarray directly to S3 631085856
1453897364 https://github.com/pydata/xarray/issues/4122#issuecomment-1453897364 https://api.github.com/repos/pydata/xarray/issues/4122 IC_kwDOAMm_X85WqLaU zoj613 44142765 2023-03-03T18:00:33Z 2023-03-03T18:00:33Z NONE

I never needed to specify an engine when writing, you only need it when reading the file. I use the engine="scipy" one for reading.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Document writing netcdf from xarray directly to S3 631085856
1401040677 https://github.com/pydata/xarray/issues/4122#issuecomment-1401040677 https://api.github.com/repos/pydata/xarray/issues/4122 IC_kwDOAMm_X85Tgi8l zoj613 44142765 2023-01-23T21:49:46Z 2023-01-23T21:52:29Z NONE

What didn't work: python f = fsspec.filesystem("s3", anon=False) with f.open("some_bucket/some_remote_destination.nc", mode="wb") as ff: xr.open_dataset("some_local_file.nc").to_netcdf(ff) this results in a OSError: [Errno 29] Seek only available in read mode exception

Changing the above to python with fsspec.open("simplecache::s3://some_bucket/some_remote_destination.nc", mode="wb") as ff: xr.open_dataset("some_local_file.nc").to_netcdf(ff) fixed it.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Document writing netcdf from xarray directly to S3 631085856
1400564474 https://github.com/pydata/xarray/issues/4122#issuecomment-1400564474 https://api.github.com/repos/pydata/xarray/issues/4122 IC_kwDOAMm_X85Teur6 zoj613 44142765 2023-01-23T15:44:20Z 2023-01-23T15:44:20Z NONE

'/silt/usgs/Projects/stellwagen/CF-1.6/BUZZ_BAY/2651-A.cdf') outfile = fsspec.open('simpl

Thanks, this actually worked for me. It seems as though initializing an s3 store using fs = fsspec.S3FileSystem(...) beforehand and using it as a context manager via with fs.open(...) as out: data.to_netcdf(out) caused the failure.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Document writing netcdf from xarray directly to S3 631085856
1400519887 https://github.com/pydata/xarray/issues/4122#issuecomment-1400519887 https://api.github.com/repos/pydata/xarray/issues/4122 IC_kwDOAMm_X85TejzP zoj613 44142765 2023-01-23T15:16:21Z 2023-01-23T15:16:21Z NONE

Is there any reliable to use to write a xr.Dataset object as a netcdf file in 2023? I tried using the above approach with fsspec but I keep getting a OSError: [Errno 29] Seek only available in read mode exception.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Document writing netcdf from xarray directly to S3 631085856

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);