home / github / issues

Menu
  • Search all tables
  • GraphQL API

issues: 1015260231

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
1015260231 I_kwDOAMm_X848g6RH 5838 update ValueError for open_mfdataset for wild-card matching 17162724 closed 0     0 2021-10-04T14:32:45Z 2021-10-11T02:58:47Z 2021-10-11T02:58:47Z CONTRIBUTOR      

What happened:

Took engine="zarr" out of my open_mfdataset call and got

``` ValueError Traceback (most recent call last) /tmp/ipykernel_24527/4212238570.py in <module> 3 TqdmCallback(desc="dask tasks").register() 4 ----> 5 ds = xr.open_mfdataset( 6 "s3://era5-pds/zarr///data/air_temperature_at_2_metres.zarr", 7 parallel=True,

/opt/userenvs/ray.bell/main/lib/python3.9/site-packages/xarray/backends/api.py in open_mfdataset(paths, chunks, concat_dim, compat, preprocess, engine, data_vars, coords, combine, parallel, join, attrs_file, combine_attrs, **kwargs) 860 paths = [fs.get_mapper(path) for path in paths] 861 elif is_remote_uri(paths): --> 862 raise ValueError( 863 "cannot do wild-card matching for paths that are remote URLs: " 864 "{!r}. Instead, supply paths as an explicit list of strings.".format(

ValueError: cannot do wild-card matching for paths that are remote URLs: 's3://era5-pds/zarr///data/air_temperature_at_2_metres.zarr'. Instead, supply paths as an explicit list of strings. ```

What you expected to happen:

Give a suggestion that this can be fixed if engine="zarr"

Minimal Complete Verifiable Example:

```python import xarray as xr

ds = xr.open_mfdataset( "s3://era5-pds/zarr/2020/1*/data/eastward_wind_at_10_metres.zarr", backend_kwargs=dict(storage_options={"anon": True}), )

Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/Users/ray/miniconda3/envs/main/lib/python3.9/site-packages/xarray/backends/api.py", line 862, in open_mfdataset raise ValueError( ValueError: cannot do wild-card matching for paths that are remote URLs: 's3://era5-pds/zarr/2020/1*/data/eastward_wind_at_10_metres.zarr'. Instead, supply paths as an explicit list of strings. ```

```python ds = xr.open_mfdataset( "s3://era5-pds/zarr/2020/1*/data/eastward_wind_at_10_metres.zarr", backend_kwargs=dict(storage_options={"anon": True}), engine="zarr", )

works

```

Anything else we need to know?:

message here: https://github.com/pydata/xarray/blob/main/xarray/backends/api.py#L861

Environment:

Output of <tt>xr.show_versions()</tt>
{
    "url": "https://api.github.com/repos/pydata/xarray/issues/5838/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 0 rows from issues_id in issues_labels
  • 0 rows from issue in issue_comments
Powered by Datasette · Queries took 0.679ms · About: xarray-datasette