home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 268120151

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/1173#issuecomment-268120151 https://api.github.com/repos/pydata/xarray/issues/1173 268120151 MDEyOklzc3VlQ29tbWVudDI2ODEyMDE1MQ== 306380 2016-12-20T00:36:32Z 2016-12-20T00:36:32Z MEMBER

There have been some efforts and progress in using many NetCDF files on a distributed POSIX filesystem (NFS, gluster, not HDFS) but there is still some pain here. We should probably circle back up and figure out what still needs to be done (do you have a firm understanding of this @shoyer ?)

HDF5 on HDFS is, I suspect, sufficiently painful so that I would be more tempted to either avoid HDFS or to try other formats like ZArr (which I'm somewhat biased towards) (cc @alimanfoo). However my experience has been that most climate data lives on a POSIX file system, so experimentation here may not be high priority.

@JoyMonteiro if you have time then the first thing to do is to probably start using things and report where they're broken. I'm confident that small things will present themselves quickly :)

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  196541604
Powered by Datasette · Queries took 0.672ms · About: xarray-datasette