home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 793502837

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/3466#issuecomment-793502837 https://api.github.com/repos/pydata/xarray/issues/3466 793502837 MDEyOklzc3VlQ29tbWVudDc5MzUwMjgzNw== 57942990 2021-03-09T07:52:55Z 2021-03-09T07:52:55Z NONE

Hi all,

I encountered the same problem when trying to save data from met.no's archived MEPS data on "https://thredds.met.no/thredds/dodsC/meps25epsarchive/" when trying to save the remote dataset as a local netCDF file.

I found that it depends on the size of the dataset I want to save and it works fine up to about 5MB file size. Thus, my workaround is to chunk the data e.g. by selecting only one ensemble member at a time, save the chunk as a file to make sure everything is downloaded, then read in again and do dataset.merge() in order to get one netCDF file.

It seems to me as if the problem could be solved by writing to hard disk in chunks.

Hope this helps to find the root of this issue....

Thanks for opening this issue @b-kode!

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  514672231
Powered by Datasette · Queries took 0.429ms · About: xarray-datasette