issue_comments

Table actions

5 rows where author_association = "NONE" and issue = 186895655 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: reactions, created_at (date), updated_at (date)

issue 1

  • Support creating DataSet from streaming object · 5 ✖

author_association 1

  • NONE · 5 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
636641496 https://github.com/pydata/xarray/issues/1075#issuecomment-636641496 https://api.github.com/repos/pydata/xarray/issues/1075 MDEyOklzc3VlQ29tbWVudDYzNjY0MTQ5Ng== JackKelly 460756 2020-06-01T06:37:08Z 2020-06-01T06:37:08Z NONE

FWIW, I've also tested @delgadom's technique, using netCDF4 and it also works well (and is useful in situations where we don't want to install h5netcdf). Thanks!

 
{
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Support creating DataSet from streaming object 186895655
635415386 https://github.com/pydata/xarray/issues/1075#issuecomment-635415386 https://api.github.com/repos/pydata/xarray/issues/1075 MDEyOklzc3VlQ29tbWVudDYzNTQxNTM4Ng== JackKelly 460756 2020-05-28T15:18:34Z 2020-05-28T15:19:06Z NONE

Is this now implemented (and hence can this issue be closed?) It appears that this works well:

python boto_s3 = boto3.client('s3') s3_object = boto_s3.get_object(Bucket=bucket, Key=key) netcdf_bytes = s3_object['Body'].read() netcdf_bytes_io = io.BytesIO(netcdf_bytes) ds = xr.open_dataset(netcdf_bytes_io)

Is that the right approach to opening a NetCDF file on S3, using the latest xarray code?

 
{
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Support creating DataSet from streaming object 186895655
373749850 https://github.com/pydata/xarray/issues/1075#issuecomment-373749850 https://api.github.com/repos/pydata/xarray/issues/1075 MDEyOklzc3VlQ29tbWVudDM3Mzc0OTg1MA== nickwg03 4528512 2018-03-16T15:30:18Z 2018-03-16T15:30:18Z NONE

@delgadom Ah, I see. I needed libnetcdf=4.5.0, I had been using an earlier version. Sounds like prior to 4.5.0 there were still some issues with the name of the file being passed into netCDF4.Dataset, as is mentioned here: https://github.com/Unidata/netcdf4-python/issues/295

 
{
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Support creating DataSet from streaming object 186895655
373517197 https://github.com/pydata/xarray/issues/1075#issuecomment-373517197 https://api.github.com/repos/pydata/xarray/issues/1075 MDEyOklzc3VlQ29tbWVudDM3MzUxNzE5Nw== nickwg03 4528512 2018-03-15T20:45:50Z 2018-03-15T20:45:50Z NONE

@delgadom which version of netCDF4 are you using? I'm following your same steps but am still receiving an [Errno 2] No such file or directory

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Support creating DataSet from streaming object 186895655
345989495 https://github.com/pydata/xarray/issues/1075#issuecomment-345989495 https://api.github.com/repos/pydata/xarray/issues/1075 MDEyOklzc3VlQ29tbWVudDM0NTk4OTQ5NQ== niallrobinson 2979205 2017-11-21T10:50:40Z 2017-11-21T10:51:43Z NONE

FWIW this would be really useful 👍 from me, specifically for the use case above of reading from s3

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Support creating DataSet from streaming object 186895655

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);