issue_comments

Table actions

3 rows where author_association = "MEMBER" and issue = 484592018 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 1

issue 1

  • to_zarr append with gcsmap does not work properly · 3 ✖

author_association 1

  • MEMBER · 3 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
524898407 https://github.com/pydata/xarray/issues/3251#issuecomment-524898407 https://api.github.com/repos/pydata/xarray/issues/3251 MDEyOklzc3VlQ29tbWVudDUyNDg5ODQwNw== rabernat 1197350 2019-08-26T15:07:19Z 2019-08-26T15:07:19Z MEMBER

Thanks for looking into this Justin. We really appreciate your efforts.

Sent from my iPhone

On Aug 26, 2019, at 7:52 AM, Justin Minsk notifications@github.com wrote:

Even with the changes in gcsfs syntax the same error still occurs since the old syntax just uses get_mapper() under the hood. I can continue to work on finding which version of gcsfs works with the current xarray code but the pinning on gcsfs, xarray, and dask on conda/conda-forge ends up getting out of sync very quickly and will take me a bit more time then I thought it would.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   to_zarr append with gcsmap does not work properly  484592018
524881403 https://github.com/pydata/xarray/issues/3251#issuecomment-524881403 https://api.github.com/repos/pydata/xarray/issues/3251 MDEyOklzc3VlQ29tbWVudDUyNDg4MTQwMw== rabernat 1197350 2019-08-26T14:25:04Z 2019-08-26T14:25:04Z MEMBER

It appears that GCSFS introduced a breaking API change with no deprecation cycle. (See https://github.com/dask/gcsfs/issues/166).

The old syntax is python gcsmap = mapping.GCSMap(gcs_bucket_name) ds = xr.open_zarr(gcsmap)

The new syntax is python gcs = gcsfs.GCSFileSystem(...) map = gcs.get_mapper() ds = xr.open_zarr(map)

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   to_zarr append with gcsmap does not work properly  484592018
524366070 https://github.com/pydata/xarray/issues/3251#issuecomment-524366070 https://api.github.com/repos/pydata/xarray/issues/3251 MDEyOklzc3VlQ29tbWVudDUyNDM2NjA3MA== rabernat 1197350 2019-08-23T15:49:30Z 2019-08-23T15:49:30Z MEMBER

Hi @jminsk-cc - thanks for this bug report.

There have been quite a few internal changes to gcsfs recently. I'm going to tag @martindurant, who might be able to help. Could you report your gcsfs version?

Also, I can't reproduce your example because it never assigns the gcsmap variable. I assume you intended to do python gcsmap = mapping.GCSMap(gcs_bucket_name) ?

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   to_zarr append with gcsmap does not work properly  484592018

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);