html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue https://github.com/pydata/xarray/issues/3213#issuecomment-526747770,https://api.github.com/repos/pydata/xarray/issues/3213,526747770,MDEyOklzc3VlQ29tbWVudDUyNjc0Nzc3MA==,923438,2019-08-30T20:57:54Z,2019-08-30T20:57:54Z,NONE,"Thanks. That solved that error but introduced another one. Specifically - this is my dataframe ![image](https://user-images.githubusercontent.com/923438/64050831-2d061280-cb47-11e9-915b-01fe42eadefe.png) and this is the error that I get with `sparse=True` ![image](https://user-images.githubusercontent.com/923438/64049668-91bf6e00-cb43-11e9-921f-1a044f3446a9.png) ![image](https://user-images.githubusercontent.com/923438/64050631-a94c2600-cb46-11e9-8653-9820b445bc86.png) My numpy version is definitely about 1.16 ![image](https://user-images.githubusercontent.com/923438/64050648-b701ab80-cb46-11e9-8dac-aaf2bf9e260d.png) I also set this ```os.environ[""NUMPY_EXPERIMENTAL_ARRAY_FUNCTION""]='1'``` just in case Furthermore, I don't get this error when I don't set `sparse=True` ( I just get OOM errors but that's another matter) ... ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,479942077 https://github.com/pydata/xarray/issues/3213#issuecomment-526733257,https://api.github.com/repos/pydata/xarray/issues/3213,526733257,MDEyOklzc3VlQ29tbWVudDUyNjczMzI1Nw==,923438,2019-08-30T20:10:43Z,2019-08-30T20:10:43Z,NONE,"I cloned the master branch and installed it using 'python setup.py develop'. When I try to use the sparse data loading functionality as per ``` python oo = xa.Dataset.from_dataframe( my_df, sparse=True ) ``` I get the following error: ``` --------------------------------------------------------------------------- ModuleNotFoundError Traceback (most recent call last) in ----> 1 oo = xa.Dataset.from_dataframe( poly_df.iloc[:10000], sparse=True ) /mnt/local/xarray/xarray/core/dataset.py in from_dataframe(cls, dataframe, sparse) 4040 4041 if sparse: -> 4042 obj._set_sparse_data_from_dataframe(dataframe, dims, shape) 4043 else: 4044 obj._set_numpy_data_from_dataframe(dataframe, dims, shape) /mnt/local/xarray/xarray/core/dataset.py in _set_sparse_data_from_dataframe(self, dataframe, dims, shape) 3936 self, dataframe: pd.DataFrame, dims: tuple, shape: Tuple[int, ...] 3937 ) -> None: -> 3938 from sparse import COO 3939 3940 idx = dataframe.index ModuleNotFoundError: No module named 'sparse' ``` Any suggestions on what I need to do ? ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,479942077 https://github.com/pydata/xarray/issues/3213#issuecomment-526710709,https://api.github.com/repos/pydata/xarray/issues/3213,526710709,MDEyOklzc3VlQ29tbWVudDUyNjcxMDcwOQ==,923438,2019-08-30T18:53:44Z,2019-08-30T18:53:44Z,NONE,"Would it be possible that pd.{Series, DataFrame}.to_xarray() automatically creates a sparse dataarray - or we have a flag in to_xarray which allows controlling for this. I have a very sparse dataframe and everytime I try to convert it to xarray I blow out my memory. Keeping it sparse but logically as a DataArray would be fantastic.","{""total_count"": 2, ""+1"": 2, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,479942077