home / github / issues

Menu
  • GraphQL API
  • Search all tables

issues: 706507153

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
706507153 MDU6SXNzdWU3MDY1MDcxNTM= 4449 Did copy(deep=True) break with 0.16.1? 6249613 closed 0     4 2020-09-22T15:59:41Z 2023-03-12T21:08:42Z 2023-03-12T21:08:42Z NONE      

What happened: I have a script that downloads a file, reads and copies it to memory with ds.copy(deep=True), and then removes the downloaded file from disk. In 0.16.1, I get an error "No such file or directory" when I try to read the data from the deep-copied Dataset as if the Dataset was not actually copied into memory.

What you expected to happen: In 0.16.0 and earlier, the variable data is available (ds.varName.data) after it is copied into memory even after the original file was removed. But this doesn't work anymore in 0.16.1.

Minimal Complete Verifiable Example:

```python import xarray as xr import os import urllib.request

Get sample NetCDF file

url = 'https://www.unidata.ucar.edu/software/netcdf/examples/tos_O1_2001-2002.nc' FILE = 'tos_O1_2001-2002.nc' urllib.request.urlretrieve(url, FILE)

Open the NetCDF file

ds1 = xr.open_dataset(FILE)

Make a copy of the Dataset

ds2 = ds1.copy(deep=True)

and close the original

ds1.close()

remove the NetCDF file

os.remove(FILE)

Read the copied dataset

ds2 ```

Anything else we need to know?: Output for xarray v0.16.0

Output for xarray v0.16.1 FileNotFoundError: [Errno 2] No such file or directory: ...tos_O1_2001-2002.nc'

Environment:

Output of <tt>xr.show_versions()</tt> for xarray 0.16.0 INSTALLED VERSIONS ------------------ commit: None python: 3.8.5 | packaged by conda-forge | (default, Sep 16 2020, 17:19:16) [MSC v.1916 64 bit (AMD64)] python-bits: 64 OS: Windows OS-release: 10 machine: AMD64 processor: Intel64 Family 6 Model 142 Stepping 12, GenuineIntel byteorder: little LC_ALL: None LANG: None LOCALE: English_United States.1252 libhdf5: 1.10.6 libnetcdf: 4.7.4 xarray: 0.16.0 pandas: 1.1.2 numpy: 1.19.1 scipy: 1.5.0 netCDF4: 1.5.4 pydap: None h5netcdf: None h5py: 2.10.0 Nio: None zarr: None cftime: 1.2.1 nc_time_axis: None PseudoNetCDF: None rasterio: None cfgrib: 0.9.8.4 iris: None bottleneck: None dask: None distributed: None matplotlib: 3.3.2 cartopy: 0.18.0 seaborn: None numbagg: None pint: 0.16 setuptools: 49.6.0.post20200917 pip: 20.2.3 conda: None pytest: None IPython: 7.18.1 sphinx: None
Output of <tt>xr.show_versions()</tt> for xarray 0.16.1 INSTALLED VERSIONS ------------------ commit: None python: 3.8.5 | packaged by conda-forge | (default, Sep 16 2020, 17:19:16) [MSC v.1916 64 bit (AMD64)] python-bits: 64 OS: Windows OS-release: 10 machine: AMD64 processor: Intel64 Family 6 Model 142 Stepping 12, GenuineIntel byteorder: little LC_ALL: None LANG: None LOCALE: English_United States.1252 libhdf5: 1.10.6 libnetcdf: 4.7.4 xarray: 0.16.1 pandas: 1.1.2 numpy: 1.19.1 scipy: 1.5.0 netCDF4: 1.5.4 pydap: None h5netcdf: None h5py: 2.10.0 Nio: None zarr: None cftime: 1.2.1 nc_time_axis: None PseudoNetCDF: None rasterio: None cfgrib: 0.9.8.4 iris: None bottleneck: None dask: None distributed: None matplotlib: 3.3.2 cartopy: 0.18.0 seaborn: None numbagg: None pint: 0.16 setuptools: 49.6.0.post20200917 pip: 20.2.3 conda: None pytest: None IPython: 7.18.1 sphinx: Nonexarray: 0.16.0 pandas: 1.1.2 numpy: 1.19.1 scipy: 1.5.0 netCDF4: 1.5.4 pydap: None h5netcdf: None h5py: 2.10.0 Nio: None zarr: None cftime: 1.2.1 nc_time_axis: None PseudoNetCDF: None rasterio: None cfgrib: 0.9.8.4 iris: None bottleneck: None dask: None distributed: None matplotlib: 3.3.2 cartopy: 0.18.0 seaborn: None numbagg: None pint: 0.16 setuptools: 49.6.0.post20200917 pip: 20.2.3 conda: None pytest: None IPython: 7.18.1 sphinx: None
{
    "url": "https://api.github.com/repos/pydata/xarray/issues/4449/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 0 rows from issues_id in issues_labels
  • 4 rows from issue in issue_comments
Powered by Datasette · Queries took 0.545ms · About: xarray-datasette