issue_comments

OK, here are my findings.

There are tests for this in https://github.com/pydata/xarray/blob/main/xarray/tests/test_plugins.py, but they are still using pkg_resources. Because of that, the tests did not capture this issue although we have tests for it.

While fixing the AttributeError the tests finally failed (it was using pkg_resources nomenclature).

With latest #5959 everything should be in place now.

@snowman2 #5959 should fix the AttributeError: 'EntryPoint' object has no attribute 'module_name'.

I see the same issue reported here: https://github.com/pydata/xarray/issues/5944#issuecomment-962958896

See: https://github.com/corteva/rioxarray/runs/4140632105 (Note: updated CI build link)

@snowman2 Do you get the same error when running the testsuite for rioxarray with xarray 0.20.1?

My question would be, why are those duplicates there in the first place.

When a fix is added for this, feel free to ping me to test the fix on rioxarray.

@weiji14 I've solved my issue by invoking pytest with --import-mode="append" outside the package directory.

To use the select method, the following should be changed:

• Swap the imports so that newer importlib_metadata is imported first: https://github.com/pydata/xarray/blob/e0deb9cf0a5cd5c9e3db033fd13f075added9c1e/xarray/backends/plugins.py#L8-L12
• Require importlib_metadata for Python < 3.10 https://github.com/pydata/xarray/blob/e0deb9cf0a5cd5c9e3db033fd13f075added9c1e/setup.cfg#L81

@kmuehlbauer

• Add a breakpoint() below line 102 and print out entrypoints. Step into build_engines follow it using the debugger.
• Can you also try this suggestion https://github.com/pydata/xarray/issues/5944#issuecomment-962414054

@ashwinvis @weiji14 I've encountered the same problem. As there is possibly a bug in remove_duplicates, another issue is hidden deeper.

https://github.com/pydata/xarray/blob/e0deb9cf0a5cd5c9e3db033fd13f075added9c1e/xarray/backends/plugins.py#L100-L103

Here entry_points is called and for some reason it returns the xarray.backends twice (but only if invoked via pytest). This can be followed down to importlib/metadata.py distributions() which finds the package under test twice. This is as far as I could get.

Any help very much appreciated.

I'm getting a similar issue with xarray=0.20.1 when rioxarray and rasterio are both installed, looks like #5931 didn't fully fix things? Here's the full traceback.

```python-traceback __ testopen_variable_filter[open_rasterio_engine] ___

open_rasterio = <function open_rasterio_engine at 0x7fa99ca7ec10>

def test_open_variable_filter(open_rasterio):

  with open_rasterio(
        os.path.join(TEST_INPUT_DATA_DIR, "PLANET_SCOPE_3D.nc"), variable=["blue"]
    ) as rds:

test/integration/test_integration__io.py:185:

test/conftest.py:103: in open_rasterio_engine return xr.open_dataset(file_name_or_object, engine="rasterio", **kwargs) ../../../miniconda3/envs/rioxarray/lib/python3.9/site-packages/xarray/backends/api.py:481: in open_dataset backend = plugins.get_backend(engine) ../../../miniconda3/envs/rioxarray/lib/python3.9/site-packages/xarray/backends/plugins.py:158: in get_backend engines = list_engines() ../../../miniconda3/envs/rioxarray/lib/python3.9/site-packages/xarray/backends/plugins.py:103: in list_engines return build_engines(entrypoints) ../../../miniconda3/envs/rioxarray/lib/python3.9/site-packages/xarray/backends/plugins.py:92: in build_engines entrypoints = remove_duplicates(entrypoints)

entrypoints = [EntryPoint(name='rasterio', value='rioxarray.xarray_plugin:RasterioBackend', group='xarray.backends'), EntryPoint(nam...rray.backends'), EntryPoint(name='rasterio', value='rioxarray.xarray_plugin:RasterioBackend', group='xarray.backends')]

def remove_duplicates(entrypoints):
    # sort and group entrypoints by name
    entrypoints = sorted(entrypoints, key=lambda ep: ep.name)
    entrypoints_grouped = itertools.groupby(entrypoints, key=lambda ep: ep.name)
    # check if there are multiple entrypoints for the same name
    unique_entrypoints = []
    for name, matches in entrypoints_grouped:
        matches = list(matches)
        unique_entrypoints.append(matches[0])
        matches_len = len(matches)
        if matches_len > 1:

          selected_module_name = matches[0].module_name

E AttributeError: 'EntryPoint' object has no attribute 'module_name'

../../../miniconda3/envs/rioxarray/lib/python3.9/site-packages/xarray/backends/plugins.py:29: AttributeError ================================ warnings summary ================================= test/integration/test_integration__io.py::test_open_variable_filter[open_rasterio] /home/username/projects/rioxarray/rioxarray/_io.py:366: DeprecationWarning: string or file could not be read to its end due to unmatched data; this will raise a ValueError in the future. new_val = np.fromstring(value.strip("{}"), dtype="float", sep=",")

-- Docs: https://docs.pytest.org/en/stable/warnings.html ============================= short test summary info ============================= FAILED test/integration/test_integration__io.py::test_open_variable_filter[open_rasterio_engine] !!!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!!

```

Output of xr.show_versions()

On a side note, the syntax .get is deprecated in the importlib_metadata package and most likely in Python 3.10's importlib.metadata stdlib.

```py

In [16]: from importlib_metadata import entry_points

In [17]: entry_points().get('xarray.backends', ()) <ipython-input-17-5f3ea0df5c10>:1: DeprecationWarning: SelectableGroups dict interface is deprecated. Use select. entry_points().get('xarray.backends', ()) Out[17]: [EntryPoint(name='rasterio', value='rioxarray.xarray_plugin:RasterioBackend', group='xarray.backends'), EntryPoint(name='pymech', value='pymech.dataset:PymechXarrayBackend', group='xarray.backends')]

In [18]: entry_points().select(group='xarray.backends') Out[18]: [EntryPoint(name='rasterio', value='rioxarray.xarray_plugin:RasterioBackend', group='xarray.backends'), EntryPoint(name='pymech', value='pymech.dataset:PymechXarrayBackend', group='xarray.backends')] ```