html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue https://github.com/pydata/xarray/issues/1106#issuecomment-262387452,https://api.github.com/repos/pydata/xarray/issues/1106,262387452,MDEyOklzc3VlQ29tbWVudDI2MjM4NzQ1Mg==,10050469,2016-11-22T22:39:25Z,2016-11-22T22:39:25Z,MEMBER,"@ocefpaf where you able to make any progress on this? (reminder: NetCDF4 is not installed properly on RTD, with ImportError ``libmfhdf.so.0: cannot open shared object file: No such file or directory``) If you're busy, I could try to do some trials by adding some other packages to the configuration. This is quite silly, but for some reason I have no such problems with netCDF4 on my salem RTD builds, with a similar config (the only difference I see is the higher number of packages: https://github.com/fmaussion/salem/blob/master/docs/environment.yml)","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-260032970,https://api.github.com/repos/pydata/xarray/issues/1106,260032970,MDEyOklzc3VlQ29tbWVudDI2MDAzMjk3MA==,10050469,2016-11-11T19:15:17Z,2016-11-11T19:15:17Z,MEMBER,"We are talking about two different issues here. I'll open another issue for the rasm file. ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-260029534,https://api.github.com/repos/pydata/xarray/issues/1106,260029534,MDEyOklzc3VlQ29tbWVudDI2MDAyOTUzNA==,10050469,2016-11-11T18:59:46Z,2016-11-11T18:59:46Z,MEMBER,"Because you have a `RuntimeWarning` when reading already ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-260029349,https://api.github.com/repos/pydata/xarray/issues/1106,260029349,MDEyOklzc3VlQ29tbWVudDI2MDAyOTM0OQ==,10050469,2016-11-11T18:58:56Z,2016-11-11T18:58:56Z,MEMBER,"I thought I was able to solve the datetime issue by updating netCDF4 -- do you have the same version in both environments? ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-260028121,https://api.github.com/repos/pydata/xarray/issues/1106,260028121,MDEyOklzc3VlQ29tbWVudDI2MDAyODEyMQ==,10050469,2016-11-11T18:53:25Z,2016-11-11T18:53:25Z,MEMBER,"The error is visible [here](http://xarray.pydata.org/en/latest/examples/multidimensional-coords.html) the latest build logs are available [here](https://readthedocs.org/projects/xray/builds/4651830/) thanks! ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-260027243,https://api.github.com/repos/pydata/xarray/issues/1106,260027243,MDEyOklzc3VlQ29tbWVudDI2MDAyNzI0Mw==,10050469,2016-11-11T18:49:25Z,2016-11-11T18:49:25Z,MEMBER,"OK, so this didn't help. I'm happy with leaving netCDF4 out of RTD, but I'm unable to convert the rasm file because of the bug I mentioned above. ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-259821280,https://api.github.com/repos/pydata/xarray/issues/1106,259821280,MDEyOklzc3VlQ29tbWVudDI1OTgyMTI4MA==,10050469,2016-11-10T22:05:04Z,2016-11-10T22:05:04Z,MEMBER,"I wonder if you can reproduce this? ``` python import xarray as xr ds = xr.tutorial.load_dataset('rasm') ds.to_netcdf('rasm.nc', format='NETCDF3_CLASSIC', engine='scipy') ``` ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-259792002,https://api.github.com/repos/pydata/xarray/issues/1106,259792002,MDEyOklzc3VlQ29tbWVudDI1OTc5MjAwMg==,10050469,2016-11-10T20:00:45Z,2016-11-10T20:00:45Z,MEMBER,"I wanted to be sure that IO works well with the scipy engine, but I get this error below. Does that look familiar to you? ``` python import xarray as xr ds = xr.open_dataset('/home/mowglie/Downloads/rasm.nc') ds.Tair.encoding['dtype'] = 'float32' ds.to_netcdf('/home/mowglie/rasm.nc', format='NETCDF3_CLASSIC', engine='scipy') --------------------------------------------------------------------------- ValueError Traceback (most recent call last) /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/backends/api.py in to_netcdf(dataset, path, mode, format, group, engine, writer, encoding) 353 try: --> 354 dataset.dump_to_store(store, sync=sync, encoding=encoding) 355 if isinstance(path, BytesIO): /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/core/dataset.py in dump_to_store(self, store, encoder, sync, encoding) 729 if sync: --> 730 store.sync() 731 /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/backends/scipy_.py in sync(self) 147 super(ScipyDataStore, self).sync() --> 148 self.ds.flush() 149 /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in flush(self) 388 if hasattr(self, 'mode') and self.mode in 'wa': --> 389 self._write() 390 sync = flush /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write(self) 400 self._write_gatt_array() --> 401 self._write_var_array() 402 /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write_var_array(self) 448 for name in variables: --> 449 self._write_var_metadata(name) 450 # Now that we have the metadata, we know the vsize of /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write_var_metadata(self, name) 466 for dimname in var.dimensions: --> 467 dimid = self._dims.index(dimname) 468 self._pack_int(dimid) ValueError: '2' is not in list During handling of the above exception, another exception occurred: ValueError Traceback (most recent call last) in () 2 ds = xr.open_dataset('/home/mowglie/Downloads/rasm.nc') 3 ds.Tair.encoding['dtype'] = 'float32' ----> 4 ds.to_netcdf('/home/mowglie/rasm.nc', format='NETCDF3_CLASSIC', engine='scipy') /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/core/dataset.py in to_netcdf(self, path, mode, format, group, engine, encoding) 780 from ..backends.api import to_netcdf 781 return to_netcdf(self, path, mode, format=format, group=group, --> 782 engine=engine, encoding=encoding) 783 784 dump = utils.function_alias(to_netcdf, 'dump') /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/backends/api.py in to_netcdf(dataset, path, mode, format, group, engine, writer, encoding) 357 finally: 358 if sync: --> 359 store.close() 360 361 if not sync: /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/xarray/backends/scipy_.py in close(self) 149 150 def close(self): --> 151 self.ds.close() 152 153 def __exit__(self, type, value, tb): /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in close(self) 277 if not self.fp.closed: 278 try: --> 279 self.flush() 280 finally: 281 self.variables = {} /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in flush(self) 387 """""" 388 if hasattr(self, 'mode') and self.mode in 'wa': --> 389 self._write() 390 sync = flush 391 /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write(self) 399 self._write_dim_array() 400 self._write_gatt_array() --> 401 self._write_var_array() 402 403 def _write_numrecs(self): /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write_var_array(self) 447 # Set the metadata for all variables. 448 for name in variables: --> 449 self._write_var_metadata(name) 450 # Now that we have the metadata, we know the vsize of 451 # each record variable, so we can calculate recsize. /home/mowglie/.bin/conda/envs/climate/lib/python3.5/site-packages/scipy/io/netcdf.py in _write_var_metadata(self, name) 465 self._pack_int(len(var.dimensions)) 466 for dimname in var.dimensions: --> 467 dimid = self._dims.index(dimname) 468 self._pack_int(dimid) 469 ValueError: '2' is not in list ``` ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-259788569,https://api.github.com/repos/pydata/xarray/issues/1106,259788569,MDEyOklzc3VlQ29tbWVudDI1OTc4ODU2OQ==,10050469,2016-11-10T19:46:58Z,2016-11-10T19:46:58Z,MEMBER,"Yes, with the following code the file size goes down to 9mb: ``` python import xarray as xr ds = xr.open_dataset('/home/tt/Downloads/rasm.nc') ds.Tair.encoding['dtype'] = 'float32' ds.to_netcdf('/home/tt/rasm.nc', format='NETCDF3_CLASSIC') ``` ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022 https://github.com/pydata/xarray/issues/1106#issuecomment-259786864,https://api.github.com/repos/pydata/xarray/issues/1106,259786864,MDEyOklzc3VlQ29tbWVudDI1OTc4Njg2NA==,10050469,2016-11-10T19:40:10Z,2016-11-10T19:40:10Z,MEMBER,"I'm happy to do the conversion if you want. One could compress the file a little bit by changing the data to float32, too ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,188565022