html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue
https://github.com/pydata/xarray/pull/2559#issuecomment-444333050,https://api.github.com/repos/pydata/xarray/issues/2559,444333050,MDEyOklzc3VlQ29tbWVudDQ0NDMzMzA1MA==,1197350,2018-12-05T02:15:48Z,2018-12-05T02:15:48Z,MEMBER,"If anyone wants to see how awesome consolidated metadata is, you can try it in this binder:
https://github.com/rabernat/pangeo_ecco_examples/
I did a bit of lazy profiling here:
https://gist.github.com/rabernat/ce1fb414cf53541afe2245363b06c49d
Things that used to take ~40s now take ~1s. Especially since loading the data is one of the first steps in any pangeo notebook, this is a *huge* improvement in usability.
Thanks to everyone who helped make it happen!","{""total_count"": 2, ""+1"": 1, ""-1"": 0, ""laugh"": 0, ""hooray"": 1, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-444303363,https://api.github.com/repos/pydata/xarray/issues/2559,444303363,MDEyOklzc3VlQ29tbWVudDQ0NDMwMzM2Mw==,1197350,2018-12-04T23:47:06Z,2018-12-04T23:47:06Z,MEMBER,"👍
Sent from my iPhone
> On Dec 4, 2018, at 6:37 PM, Stephan Hoyer wrote:
>
> @rabernat if you're ready, let's merge this.
>
> The failures on Appveyor are related (an issue with int32 and cftime)
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub, or mute the thread.
","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-444219121,https://api.github.com/repos/pydata/xarray/issues/2559,444219121,MDEyOklzc3VlQ29tbWVudDQ0NDIxOTEyMQ==,1197350,2018-12-04T19:06:16Z,2018-12-04T19:06:16Z,MEMBER,"> We may also need some text around updating consolidated data-sets, but that can maybe wait to see what kind of usage people try.
Since xarray cannot append or modify in-place existing zarr stores, this seems outside the scope of xarray for now. But maybe it is worth mentioning in the docs.","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-443304443,https://api.github.com/repos/pydata/xarray/issues/2559,443304443,MDEyOklzc3VlQ29tbWVudDQ0MzMwNDQ0Mw==,1197350,2018-11-30T18:59:06Z,2018-11-30T18:59:06Z,MEMBER,"Keywords are now all `consolidated` and all tests are go.
Ready to merge?","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-442580875,https://api.github.com/repos/pydata/xarray/issues/2559,442580875,MDEyOklzc3VlQ29tbWVudDQ0MjU4MDg3NQ==,1197350,2018-11-28T19:49:02Z,2018-11-28T19:49:02Z,MEMBER,"> Will the default for both options be `False` for the time being?
Yes","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-442575389,https://api.github.com/repos/pydata/xarray/issues/2559,442575389,MDEyOklzc3VlQ29tbWVudDQ0MjU3NTM4OQ==,1197350,2018-11-28T19:33:01Z,2018-11-28T19:33:01Z,MEMBER,"So if the test issues can be considered resolved, the only decision we need to make is about the API.
Do we prefer (the current way):
```python
ds.to_zarr(fname, consolidate=True)
xr.open_zarr(fname, consolidated=True)
```
or @shoyer's suggestion
```python
ds.to_zarr(fname, consolidated=True)
xr.open_zarr(fname, consolidated=True)
```
???","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-442557300,https://api.github.com/repos/pydata/xarray/issues/2559,442557300,MDEyOklzc3VlQ29tbWVudDQ0MjU1NzMwMA==,1197350,2018-11-28T18:38:23Z,2018-11-28T18:38:23Z,MEMBER,"Not sure I understand why there are tests failing now. The failing function is `test_basic_compute`.
https://travis-ci.org/pydata/xarray/jobs/460873430#L7489
At first glance, this does not appear to have anything to do with my PR. The relevant error is:
```
______________________________ test_basic_compute ______________________________
def test_basic_compute():
ds = Dataset({'foo': ('x', range(5)),
'bar': ('x', range(5))}).chunk({'x': 2})
for get in [dask.threaded.get,
dask.multiprocessing.get,
dask.local.get_sync,
None]:
with (dask.config.set(scheduler=get)
if LooseVersion(dask.__version__) >= LooseVersion('0.19.4')
else dask.config.set(scheduler=get)
if LooseVersion(dask.__version__) >= LooseVersion('0.18.0')
else dask.set_options(get=get)):
> ds.compute()
xarray/tests/test_dask.py:843:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
xarray/core/dataset.py:597: in compute
return new.load(**kwargs)
xarray/core/dataset.py:494: in load
evaluated_data = da.compute(*lazy_data.values(), **kwargs)
../../../miniconda/envs/test_env/lib/python3.6/site-packages/dask/base.py:390: in compute
collections=collections)
../../../miniconda/envs/test_env/lib/python3.6/site-packages/dask/base.py:865: in get_scheduler
return get_scheduler(scheduler=config.get('scheduler', None))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
get = None, scheduler = , collections = None
cls = None
def get_scheduler(get=None, scheduler=None, collections=None, cls=None):
"""""" Get scheduler function
There are various ways to specify the scheduler to use:
1. Passing in get= parameters (deprecated)
2. Passing in scheduler= parameters
3. Passing these into global confiuration
4. Using defaults of a dask collection
This function centralizes the logic to determine the right scheduler to use
from those many options
""""""
if get is not None:
if scheduler is not None:
raise ValueError(""Both get= and scheduler= provided. Choose one"")
warn_on_get(get)
return get
if scheduler is not None:
> if scheduler.lower() in named_schedulers:
E AttributeError: 'function' object has no attribute 'lower'
../../../miniconda/envs/test_env/lib/python3.6/site-packages/dask/base.py:854: AttributeError
```
","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-440285690,https://api.github.com/repos/pydata/xarray/issues/2559,440285690,MDEyOklzc3VlQ29tbWVudDQ0MDI4NTY5MA==,1197350,2018-11-20T14:09:16Z,2018-11-20T14:09:16Z,MEMBER,Also need to add some version checks...this will only work with zarr > 2.2.,"{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709
https://github.com/pydata/xarray/pull/2559#issuecomment-440136005,https://api.github.com/repos/pydata/xarray/issues/2559,440136005,MDEyOklzc3VlQ29tbWVudDQ0MDEzNjAwNQ==,1197350,2018-11-20T04:42:33Z,2018-11-20T04:42:33Z,MEMBER,Ping @lilyminium for a review.,"{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,382497709