html_url,issue_url,id,node_id,user,created_at,updated_at,author_association,body,reactions,performed_via_github_app,issue https://github.com/pydata/xarray/issues/729#issuecomment-186264260,https://api.github.com/repos/pydata/xarray/issues/729,186264260,MDEyOklzc3VlQ29tbWVudDE4NjI2NDI2MA==,16919188,2016-02-19T15:40:20Z,2016-02-19T15:40:20Z,NONE,"Tank you for your help on this, I will try myself to improve my knoledge of xarray and dask ;) ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-184157315,https://api.github.com/repos/pydata/xarray/issues/729,184157315,MDEyOklzc3VlQ29tbWVudDE4NDE1NzMxNQ==,16919188,2016-02-15T10:33:36Z,2016-02-15T10:33:36Z,NONE,"@mrocklin is that new link working ? Because it's gonna be closed tomorow. ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-182875655,https://api.github.com/repos/pydata/xarray/issues/729,182875655,MDEyOklzc3VlQ29tbWVudDE4Mjg3NTY1NQ==,16919188,2016-02-11T13:57:51Z,2016-02-11T13:57:51Z,NONE,"You don't have to apologize for the delay, i'm already grateful for your time on this ! I don't understand why this download won't work with you; I tried with other and everything was ok... Maybe you can try with this link : [https://sharing.oodrive.com/easyshare/fwd/link=BS6TALAs9CiQg.WNotfITA](https://sharing.oodrive.com/easyshare/fwd/link=BS6TALAs9CiQg.WNotfITA) ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-181418291,https://api.github.com/repos/pydata/xarray/issues/729,181418291,MDEyOklzc3VlQ29tbWVudDE4MTQxODI5MQ==,16919188,2016-02-08T15:12:21Z,2016-02-08T15:12:21Z,NONE,"@mrocklin I finally gave you a free acces path on ftp://ftp.irsn.fr/argon/SHARE/ ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-181265026,https://api.github.com/repos/pydata/xarray/issues/729,181265026,MDEyOklzc3VlQ29tbWVudDE4MTI2NTAyNg==,16919188,2016-02-08T09:08:20Z,2016-02-08T13:10:25Z,NONE,"@mrocklin I put my files on ftp://ftp.irsn.fr/argon/SHARE/, everything is in the DEBUG.zip file. @shoyer I have tried replacing sum() by dot() but I get an error ""Data Array has no attribute 'dot' "" ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-178503671,https://api.github.com/repos/pydata/xarray/issues/729,178503671,MDEyOklzc3VlQ29tbWVudDE3ODUwMzY3MQ==,16919188,2016-02-02T10:45:12Z,2016-02-02T17:07:41Z,NONE,"@shoyer @mrocklin I can send you my files, with the two netCDF4 source files and the script. I will also join the Bokeh graph for only one variable which fit with memory. Do you know how I can send you the ZIP folder ? It's 830 MB. ","{""total_count"": 0, ""+1"": 0, ""-1"": 0, ""laugh"": 0, ""hooray"": 0, ""confused"": 0, ""heart"": 0, ""rocket"": 0, ""eyes"": 0}",,129150619 https://github.com/pydata/xarray/issues/729#issuecomment-176693726,https://api.github.com/repos/pydata/xarray/issues/729,176693726,MDEyOklzc3VlQ29tbWVudDE3NjY5MzcyNg==,16919188,2016-01-29T11:00:02Z,2016-01-29T11:00:02Z,NONE,"@mrocklin I have tried your lines, it seemed to work but finally I got the memory error message. However the crash was different than what I used to have... My dataset is a set of several variables, which are calculated like this : I have DataArray of unitary data for four rainfall height(0,5,10,15 mm/days,""SYMB"") and another DataArray with spatialized rainfall height values (""RAIN""). ``` SYMB dask.array ``` ``` RAIN dask.array ``` Then I created an array which is the result of interpolation between this two arrays The function is : ``` python def interp(array,pluie): p0 = (array.sel(Hpluie = 5) -array.sel(Hpluie = 0))/5 p1 = (array.sel(Hpluie = 10) -array.sel(Hpluie = 5))/5 p2 = (array.sel(Hpluie = 15) -array.sel(Hpluie = 10))/5 interp = (p0*(pluie.where(pluie<5) - array.Hpluie.sel(Hpluie=5)) +array.sel(Hpluie=5)).fillna(0)\ +(p1*(pluie.where((pluie>=5) & (pluie<=10)) - array.Hpluie.sel(Hpluie=5)) +array.sel(Hpluie=5)).fillna(0)\ +(p2*(pluie.where(pluie>10) - array.Hpluie.sel(Hpluie=10)) + array.sel(Hpluie=10)).fillna(0) return interp ``` So M = interp(SYMB,RAIN) ``` M dask.array ``` My final variable is the product of this interpolated array and an other spatialized variable(""FLUX"") ``` FLUX dask.array ``` RES = (M \* FLUX).sum(""Paliers"") ``` RES = dask.array