issues: 164948082

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
164948082 MDExOlB1bGxSZXF1ZXN0NzcwMzE1NzI= 895 Tweaks for opening datasets 885575 closed 0     8 2016-07-11T22:08:05Z 2020-11-08T20:18:01Z 2020-11-08T20:18:01Z NONE   0 pydata/xarray/pulls/895

I tweaked the open_dataset() and open_mfdataset() functions for better performance with the PyNIO engine. 1. I use a lot of HDF4 files with what I guess I'll call "malformed names," where the file name does not end with ".hdf". PyNIO is able to figure out the format of the file, but it prints an annoying warning. As far as I can tell, the only way to shut off the warning is to tell it the format of the file, which I've added a format option for. 2. I added an option called only_variables which specifies which variables to load from the dataset in the event you don't want to load all variables. Say, for example, I have a dataset with 47 variables in it, but I only need 3 of them. If the data are not cached, then only loading the 3 I need cuts the I/O time in half. If they are cached, then loading only the 3 takes 20% of the time to load the full dataset. The only_variables option behaves pretty similarly to drop_variables. The default is to load all variables.

 
{
    "url": "https://api.github.com/repos/pydata/xarray/issues/895/reactions",
    "total_count": 1,
    "+1": 1,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
     13221727 pull

Links from other tables