html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue https://github.com/pydata/xarray/issues/1971#issuecomment-453865008,https://api.github.com/repos/pydata/xarray/issues/1971,453865008,MDEyOklzc3VlQ29tbWVudDQ1Mzg2NTAwOA==,2443309,2019-01-13T20:58:20Z,2019-01-13T20:58:20Z,MEMBER,Closing this now. The distributed integration test module seems to be covering our IO use cases well enough. I don't think we need to do anything here at this time.,"{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,302930480 https://github.com/pydata/xarray/issues/1971#issuecomment-371462262,https://api.github.com/repos/pydata/xarray/issues/1971,371462262,MDEyOklzc3VlQ29tbWVudDM3MTQ2MjI2Mg==,306380,2018-03-08T11:35:25Z,2018-03-08T11:35:25Z,MEMBER,"FWIW most of the logic within the dask collections (array, dataframe, delayed) is only tested with `dask.local.get_sync`. This also makes the test suite much faster. Obviously though for things like writing to disk it's useful to check different schedulers. ","{""total_count"": 1, ""+1"": 1, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,302930480 https://github.com/pydata/xarray/issues/1971#issuecomment-371334589,https://api.github.com/repos/pydata/xarray/issues/1971,371334589,MDEyOklzc3VlQ29tbWVudDM3MTMzNDU4OQ==,2443309,2018-03-08T00:27:52Z,2018-03-08T00:27:52Z,MEMBER,"I managed to dig up some more information here. I was having a test failure in [`test_serializable_locks`](https://github.com/jhamman/xarray/blob/5290484ff2d9402dd16a8879351dd9ec1f2d4269/xarray/tests/test_distributed.py#L173-L188) resulting in a traceback that looks like. ``` ... timeout_handle = self.add_timeout(self.time() + timeout, self.stop) self.start() if timeout is not None: self.remove_timeout(timeout_handle) if not future_cell[0].done(): > raise TimeoutError('Operation timed out after %s seconds' % timeout) E tornado.ioloop.TimeoutError: Operation timed out after 10 seconds ../../../anaconda/envs/xarray36/lib/python3.6/site-packages/tornado/ioloop.py:457: TimeoutError ``` From then on we were using the distributed scheduler and any tests that used dask resulted in a additional timeout (or similar error). Unfortunately, my attempts to provide a mcve have come up short. If I can come up with one, I'll report upstream but as it is, I can't really transfer this behavior outside of my example. cc @mrocklin ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,302930480 https://github.com/pydata/xarray/issues/1971#issuecomment-371004338,https://api.github.com/repos/pydata/xarray/issues/1971,371004338,MDEyOklzc3VlQ29tbWVudDM3MTAwNDMzOA==,1217238,2018-03-07T02:48:16Z,2018-03-07T02:48:16Z,MEMBER,"Huh, that's interesting. Yes, I suppose should at least consider parametric tests using both dask's multithreaded and distributed schedulers. Though I'll note that for test we actually set the default scheduler to dask's basic non-parallelized get, for easier debugging: https://github.com/pydata/xarray/blob/54468e1924174a03e7ead3be8545f687f084f4dd/xarray/tests/__init__.py#L87 For #1793, the key thing would be to ensure that we run the tests in the isolated context without changing the default scheduler.","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,302930480