issue_comments

Table actions

4 rows where author_association = "NONE" and issue = 569806418 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 1

issue 1

  • Dataset problem with chunk DataArray. · 4 ✖

author_association 1

  • NONE · 4 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
590375940 https://github.com/pydata/xarray/issues/3795#issuecomment-590375940 https://api.github.com/repos/pydata/xarray/issues/3795 MDEyOklzc3VlQ29tbWVudDU5MDM3NTk0MA== JavierRuano 34353851 2020-02-24T15:21:42Z 2020-02-24T15:26:57Z NONE

df1=xarray.open_mfdataset plus parallel=True df1=df1.rename({'xarray_dataarray_variable':'v'})

The chunksize changes to 365 and the dataset creates inside a Datarray of 365, not the global size which is 14610. [xarray.Dataset('u':df1,'v'df2)]

df2 same operation

Pseudo Solution for me. xarray.Dataset({'u':df1.u.chunk(14610),'v':df2.v.chunk(14610)},coords={'time':time_Index,'latitude':latitude_Index,'longitude':longitude_Index,'level':level_Index})

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Dataset problem with chunk DataArray. 569806418
590351872 https://github.com/pydata/xarray/issues/3795#issuecomment-590351872 https://api.github.com/repos/pydata/xarray/issues/3795 MDEyOklzc3VlQ29tbWVudDU5MDM1MTg3Mg== JavierRuano 34353851 2020-02-24T14:39:11Z 2020-02-24T15:06:16Z NONE

backends\api.py DATAARRAY_NAME = "xarray_dataarray_name" DATAARRAY_VARIABLE = "xarray_dataarray_variable"

The name is auto when i open the file ,xarrray.open_dataset( parallel=True)

core\dataarray.py

def rename( self, new_name_or_name_dict: Union[Hashable, Mapping[Hashable, Hashable]] = None, **names: Hashable, ) -> "DataArray":

    if names or utils.is_dict_like(new_name_or_name_dict):
        new_name_or_name_dict = cast(
            Mapping[Hashable, Hashable], new_name_or_name_dict
        )
        name_dict = either_dict_or_kwargs(new_name_or_name_dict, names, "rename")
        **dataset = self.**_to_temp_dataset()**.rename(name_dict)
        return self._from_temp_dataset(dataset)**
    else:
        new_name_or_name_dict = cast(Hashable, new_name_or_name_dict)
        return self._replace(name=new_name_or_name_dict)

I think an operation changing the previous chunksize or something with xarrray.open_dataset parallel=True, (core\parallel.py) because the chunksize changes to 365 based on days of the year Sorry i cannot help more.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Dataset problem with chunk DataArray. 569806418
590297372 https://github.com/pydata/xarray/issues/3795#issuecomment-590297372 https://api.github.com/repos/pydata/xarray/issues/3795 MDEyOklzc3VlQ29tbWVudDU5MDI5NzM3Mg== JavierRuano 34353851 2020-02-24T12:30:34Z 2020-02-24T12:30:34Z NONE

After i modify again the chunksize to 365 to avoid the Memory Error <xarray.Dataset> Dimensions: (latitude: 68, level: 47, longitude: 81, time: 14610) Data variables: u (time, level, latitude, longitude) float32 dask.array<shape=(14610, 47, 68, 81), chunksize=(365, 47, 68, 81)> v (time, level, latitude, longitude) float32 dask.array<shape=(14610, 47, 68, 81), chunksize=(365, 47, 68, 81)>

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Dataset problem with chunk DataArray. 569806418
590294555 https://github.com/pydata/xarray/issues/3795#issuecomment-590294555 https://api.github.com/repos/pydata/xarray/issues/3795 MDEyOklzc3VlQ29tbWVudDU5MDI5NDU1NQ== JavierRuano 34353851 2020-02-24T12:21:39Z 2020-02-24T12:21:39Z NONE

The strange is the DataArray chunksize changes after i modify the name 'xarray_dataarray_variable' to use another to the Dataset.

<xarray.Dataset> Dimensions: (latitude: 68, level: 47, longitude: 81, time: 14610) Data variables: u (time, level, latitude, longitude) float32 dask.array<shape=(14610, 47, 68, 81), chunksize=(14610, 47, 68, 81)> v (time, level, latitude, longitude) float32 dask.array<shape=(14610, 47, 68, 81), chunksize=(14610, 47, 68, 81)>

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
   Dataset problem with chunk DataArray. 569806418

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);