issue_comments

@shoyer I added the TestCfGrib class with basic read tests, a test GRIB file and ecCodes / cfgrib to requirements-py36.yml.

Questions: 1. ~~I failed to reach 100% coverage becasue I didn't find the way to test CfGribDataStore.get_dimensions. Any hint?~~ Done. 2. Can /should I test dask and dask.distributed support in the unit tests? How? Any pointers?

It looks like we are very close, what do you think? Shall I move to the documentation?

@shoyer I added a test for dask.distributed and it passes but please check that it is meaningful, as I'm not completely sure what to test.

@shoyer I'm ready to integrate more feedback (especially on the documentation), but I removed the WIP: prefix as I'd consider the PR good to go as soon as you like it.

Do you usually keep the history of PRs as it is or do you prefer me to rebase?

Tests added and passing with 100% coverage. Added minimal documentation.

BTW, I did a 0.9.0 beta release of cfgrib and I plan to give the public announcement tomorrow. :)

@shoyer thank you very much for the guidance, it is very appreciated!

I stared working on the tests, but I've been blocked immediately by something that looks trivial. I cannot get the test class PyNioTest to run: $ python setup.py test --addopts -v | grep Test ... xarray/tests/test_backends.py::TestCommon::test_robust_getitem PASSED [ 2%] xarray/tests/test_backends.py::TestRasterio::test_serialization SKIPPED [ 3%] xarray/tests/test_backends.py::TestRasterio::test_utm SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_non_rectilinear SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_platecarree SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_notransform SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_indexing SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_caching SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_chunks SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_pickle_rasterio SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_ENVI_tags SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_no_mftime SKIPPED [ 4%] xarray/tests/test_backends.py::TestRasterio::test_http_url SKIPPED [ 4%] xarray/tests/test_backends.py::TestEncodingInvalid::test_extract_nc4_variable_encoding PASSED [ 4%] xarray/tests/test_backends.py::TestEncodingInvalid::test_extract_h5nc_encoding PASSED [ 4%] xarray/tests/test_backends.py::TestValidateAttrs::test_validating_attrs PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_dataarray_to_netcdf_no_name PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_dataarray_to_netcdf_with_name PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_dataarray_to_netcdf_coord_name_clash PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_open_dataarray_options PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_dataarray_to_netcdf_return_bytes PASSED [ 4%] xarray/tests/test_backends.py::TestDataArrayToNetCDF::test_dataarray_to_netcdf_no_name_pathlib PASSED [ 4%] ... How do you make pytest run test classes that do not start with Test?

@shoyer BTW what timeframe do you expect for the v0.11 release? And would you consider merging this Pull Request before the release, assuming that we do a cfgrib release with read support declared beta?

The cfgrib_.py backend now uses the new CachingFileManager interface and I added a global process lock, just-in-case. The code is very simple and I mimicked the PyNIO backend so I expect it to work correctly with dask, but I'm not sure how to test for it.

Furthermore I expect dask performance to be abysmal until I implement ecmwf/cfgrib#20.

@shoyer at long last! :)

I quickly sync'ed with the new backend API. I did some light testing.

Note that I didn't test with dask at all and I'm not using the passed lock. Pointers to how to properly use the new backend interface are welcome.