issue_comments: 966758709
This data as json
html_url | issue_url | id | node_id | user | created_at | updated_at | author_association | body | reactions | performed_via_github_app | issue |
---|---|---|---|---|---|---|---|---|---|---|---|
https://github.com/pydata/xarray/issues/5878#issuecomment-966758709 | https://api.github.com/repos/pydata/xarray/issues/5878 | 966758709 | IC_kwDOAMm_X845n5E1 | 48723181 | 2021-11-12T02:05:04Z | 2021-11-12T02:05:04Z | NONE | Thanks for taking a look @rabernat. The code below writes a new zarr and checks immediately if it's there using gcsfs. It seems to appear within a few seconds. Is this what you meant? ``` %%time import fsspec import xarray as xr import json import gcsfs define a mapper to the ldeo-glaciology bucket. - needs a tokenwith open('../secrets/ldeo-glaciology-bc97b12df06b.json') as token_file: token = json.load(token_file) get a mapper with fsspec for a new zarrmapper = fsspec.get_mapper('gs://ldeo-glaciology/append_test/test11', mode='w', token=token) check what files are in therefs = gcsfs.GCSFileSystem(project='pangeo-integration-te-3eea', mode='ab', cache_timeout = 0) print('Files in the test directory before writing:') filesBefore = fs.ls('gs://ldeo-glaciology/append_test/') print(*filesBefore,sep='\n') define a simple datasetsds0 = xr.Dataset({'temperature': (['time'], [50, 51, 52])}, coords={'time': [1, 2, 3]}) write the simple dataset to zarrds0.to_zarr(mapper) check to see if the new file is thereprint('Files in the test directory after writing:')
filesAfter = fs.ls('gs://ldeo-glaciology/append_test/')
print(*filesAfter,sep='\n')
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
1030811490 |