home / github / issue_comments

Menu
  • Search all tables
  • GraphQL API

issue_comments: 1093300764

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/pull/6402#issuecomment-1093300764 https://api.github.com/repos/pydata/xarray/issues/6402 1093300764 IC_kwDOAMm_X85BKnIc 38358698 2022-04-08T19:51:24Z 2022-04-08T19:51:24Z CONTRIBUTOR

@stanwest Can you suggest how to fix this merge conflict please?

Sure. I recommend the following before the return statement in xarray.core.dataset._get_chunk:

```python

Warn where requested chunks break preferred chunks, provided that the variable

contains data.

if var.size: for dim, size, chunk_sizes in zip(dims, shape, chunk_shape): try: preferred_chunk_sizes = preferred_chunks[dim] except KeyError: continue # Determine the stop indices of the preferred chunks, but omit the last stop # (equal to the dim size). In particular, assume that when a sequence # expresses the preferred chunks, the sequence sums to the size. preferred_stops = ( range(preferred_chunk_sizes, size, preferred_chunk_sizes) if isinstance(preferred_chunk_sizes, Number) else itertools.accumulate(preferred_chunk_sizes[:-1]) ) # Gather any stop indices of the specified chunks that are not a stop index # of a preferred chunk. Again, omit the last stop, assuming that it equals # the dim size. breaks = set(itertools.accumulate(chunk_sizes[:-1])).difference( preferred_stops ) if breaks: warnings.warn( "The specified Dask chunks separate the stored chunks along " f'dimension "{dim}" starting at index {min(breaks)}. This could ' "degrade performance. Instead, consider rechunking after loading." ) ```

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  1177669703
Powered by Datasette · Queries took 0.589ms · About: xarray-datasette