home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 1286980037

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/7191#issuecomment-1286980037 https://api.github.com/repos/pydata/xarray/issues/7191 1286980037 IC_kwDOAMm_X85MtcHF 14932329 2022-10-21T13:42:41Z 2022-10-21T13:42:41Z NONE

@kmuehlbauer So it looks like uwnd.encoding does contain _FillVale and missing_value which are contrasting. Setting them to equal values enables a save.

However, these variables were set to contrasting values after an xarray subset or save. See workflow below. It appears that to_netcdf will assign '_FillValue': nan. I don't know if this is behavior that requires a change, or if it is just a quirk that folks will have to work through.

python fn_E20c_VP=sorted(glob.glob('/Users/wchapman/Downloads/uvwndNOAA/uwnd*.nc')) DSorig = xr.open_dataset(fn_E20c_VP[0]) DSorig.uwnd.encoding {'zlib': True, 'szip': False, 'zstd': False, 'bzip2': False, 'blosc': False, 'shuffle': True, 'complevel': 2, 'fletcher32': False, 'contiguous': False, 'chunksizes': (1, 1, 73, 144), 'least_significant_digit': 1, 'source': '/Users/wchapman/Downloads/uvwndNOAA/uwnd.1950.nc', 'original_shape': (365, 17, 73, 144), 'dtype': dtype('float32'), 'missing_value': -9.96921e+36} Subset and Save: python fn_E20c_VP=sorted(glob.glob('/Users/wchapman/Downloads/uvwndNOAA/uwnd*.nc')) DS_subset = DSorig.sel(level=300) DS_subset.to_netcdf('/Users/wchapman/Downloads/test_behavior.nc') DS_subset.uwnd.encoding {'zlib': True, 'szip': False, 'zstd': False, 'bzip2': False, 'blosc': False, 'shuffle': True, 'complevel': 2, 'fletcher32': False, 'contiguous': False, 'chunksizes': (1, 1, 73, 144), 'least_significant_digit': 1, 'source': '/Users/wchapman/Downloads/uvwndNOAA/uwnd.1950.nc', 'original_shape': (365, 17, 73, 144), 'dtype': dtype('float32'), 'missing_value': -9.96921e+36} Re-open newly saved file and inspect :

python DS_subset_aftersave = xr.open_dataset('/Users/wchapman/Downloads/test_behavior.nc') DS_subset_aftersave.uwnd.encoding {'zlib': True, 'szip': False, 'zstd': False, 'bzip2': False, 'blosc': False, 'shuffle': True, 'complevel': 2, 'fletcher32': False, 'contiguous': False, 'chunksizes': (1, 73, 144), 'least_significant_digit': 1, 'source': '/Users/wchapman/Downloads/test_behavior.nc', 'original_shape': (365, 73, 144), 'dtype': dtype('float32'), 'missing_value': -9.96921e+36, '_FillValue': nan, 'coordinates': 'level'}

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  1416709246
Powered by Datasette · Queries took 0.735ms · About: xarray-datasette