issue_comments

Thanks @keewis that's right, looks like they are still working on the docs, it was confusing.

Hi everyone, I've hit a problem where I need to read ncml to xarray, which brought me here... Just wondering if there are any updates regarding this?

p/s xncml is broken at the moment.

Thank you.

It's worth pointing out that you can create FileReferenceSystem JSON to accomplish many of the tasks we used to use NcML for: * create a single virtual dataset that points to a collection of files * modify dataset and variable attributes

It also has the nice feature that it makes your dataset faster to work with on the cloud because the map to the data is loaded in one shot!

This just popped up in my inbox and reminded me of the conversation I had with @rabernathttps://github.com/rabernat a few years back at a DRAKKAR meeting in France.

I haven't really kept up with things since then, but 6+ years ago we modified one of our python tools to abstract the IO method from the user by using NCML files as input. Then either the mfdataset or the unidata Java Netcdf library was used to access local or remote data (single file, directory or aggregation). As there wasn't any native NCML parser in python, and we had limited time, we ended up using pyjniushttps://github.com/kivy/pyjnius to call the netcdf java class from python which gave us access to the directory scan, aggregation functions etc from the Java Library.... probably not the most efficient way - but we've been using it ever since. I don't have a huge amount of time (or expertise), but happy to get involved if I can.

From: Ryan Abernathey notifications@github.com Sent: 03 September 2020 15:47 To: pydata/xarray xarray@noreply.github.com Cc: Harle, James jdha@noc.ac.uk; Mention mention@noreply.github.com Subject: Re: [pydata/xarray] read ncml files to create multifile datasets (#2697)

Thanks for reviving this @huardhttps://github.com/huard!

FWIW, I think it's best for this sort of utility to live in its own small standalone package, which I have referred to as "xarray-mergetool" in the past. NCML could be one special case of the things it could it. It would also be very useful for intake-esm.

We have also discussed this in NCAR/esm-collection-spec#12https://github.com/NCAR/esm-collection-spec/issues/12

We should have some bandwidth to work on this over the next year via the pangeo-forge project.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/pydata/xarray/issues/2697#issuecomment-686543493, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACN66WFQ43YO36IEE6NMMDDSD6UABANCNFSM4GRUVDBQ.

This email and any attachments are intended solely for the use of the named recipients. If you are not the intended recipient you must not use, disclose, copy or distribute this email or any of its attachments and should notify the sender immediately and delete this email from your system. The National Oceanography Centre (NOC) has taken every reasonable precaution to minimise risk of this email or any attachments containing viruses or malware but the recipient should carry out its own virus and malware checks before opening the attachments. NOC does not accept any liability for any losses or damages which the recipient may sustain due to presence of any viruses. Opinions, conclusions or other information in this message and attachments that are not related directly to NOC business are solely those of the author and do not represent the views of NOC.