home / github

Menu
  • Search all tables
  • GraphQL API

issue_comments

Table actions
  • GraphQL API for issue_comments

5 rows where issue = 642452713 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 3

  • Ahmadffrahmand 3
  • jhamman 1
  • fmaussion 1

author_association 2

  • NONE 3
  • MEMBER 2

issue 1

  • Memory Error · 5 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
655359553 https://github.com/pydata/xarray/issues/4166#issuecomment-655359553 https://api.github.com/repos/pydata/xarray/issues/4166 MDEyOklzc3VlQ29tbWVudDY1NTM1OTU1Mw== Ahmadffrahmand 29349585 2020-07-08T08:04:59Z 2020-07-08T08:04:59Z NONE

Respected Fabien,

Thank you so much, by replacing the ds_all everything works well now. and I installed the dask and toolz package.

Regards

On Sun, Jun 21, 2020 at 2:33 PM Fabien Maussion notifications@github.com wrote:

L67: try to replace

ds_all = xr.merge([xr.open_dataset(f) for f in flist])

by

ds_all = xr.open_mfdataset(flist)

You'll need to install dask https://docs.dask.org for this to work. Note that if you have A LOT of files this might still take some time.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pydata/xarray/issues/4166#issuecomment-647184580, or unsubscribe https://github.com/notifications/unsubscribe-auth/AG75NUKLONDDGXR6LNSOB73RXZ4CXANCNFSM4ODR5K4A .

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Memory Error  642452713
647184580 https://github.com/pydata/xarray/issues/4166#issuecomment-647184580 https://api.github.com/repos/pydata/xarray/issues/4166 MDEyOklzc3VlQ29tbWVudDY0NzE4NDU4MA== fmaussion 10050469 2020-06-21T21:33:20Z 2020-06-21T21:33:20Z MEMBER

L67: try to replace

ds_all = xr.merge([xr.open_dataset(f) for f in flist])

by

ds_all = xr.open_mfdataset(flist)

You'll need to install dask for this to work. Note that if you have A LOT of files this might still take some time.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Memory Error  642452713
647085606 https://github.com/pydata/xarray/issues/4166#issuecomment-647085606 https://api.github.com/repos/pydata/xarray/issues/4166 MDEyOklzc3VlQ29tbWVudDY0NzA4NTYwNg== Ahmadffrahmand 29349585 2020-06-21T06:33:54Z 2020-06-21T10:52:58Z NONE

Respected Sir, I am using a python script to extract Ground water storage. and first i have to concatenate all the satellite images i download using this script. when i run the concatenation i am getting this error File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 629, in _ensure_cached self.array = NumpyIndexingAdapter(np.asarray(self.array)) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 610, in __array__ return np.asarray(self.array, dtype=dtype) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 516, in __array__ return np.asarray(array[self.key], dtype=None) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/coding/variables.py", line 69, in __array__ return self.func(self.array) File "/usr/local/lib/python3.6/dist-packages/xarray/coding/variables.py", line 140, in _apply_mask return np.where(condition, decoded_fill_value, data) MemoryError i copied the path for the concatenation code and its github. here it is https://github.com/c-h-david/shbaam/blob/master/src/shbaam_conc.py

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Memory Error  642452713
647073813 https://github.com/pydata/xarray/issues/4166#issuecomment-647073813 https://api.github.com/repos/pydata/xarray/issues/4166 MDEyOklzc3VlQ29tbWVudDY0NzA3MzgxMw== jhamman 2443309 2020-06-21T03:28:26Z 2020-06-21T03:28:26Z MEMBER

@Ahmadffrahmand - would you mind editing the original comment, adding details in all the templated sections? As it stands, you haven't provided enough information for us to help you in any way.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Memory Error  642452713
647050354 https://github.com/pydata/xarray/issues/4166#issuecomment-647050354 https://api.github.com/repos/pydata/xarray/issues/4166 MDEyOklzc3VlQ29tbWVudDY0NzA1MDM1NA== Ahmadffrahmand 29349585 2020-06-20T22:04:42Z 2020-06-20T22:04:42Z NONE

What happened:

What you expected to happen:

Minimal Complete Verifiable Example:

```python

Put your MCVE code here

```

Anything else we need to know?:

Environment:

Output of xr.show_versions()

What happened:

What you expected to happen:

Minimal Complete Verifiable Example:

```python

Put your MCVE code here

```

Anything else we need to know?:

Environment:

Output of xr.show_versions()

i would like to concanicate 183 files of Netcdf i am getting this error. File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 629, in _ensure_cached self.array = NumpyIndexingAdapter(np.asarray(self.array)) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 610, in array return np.asarray(self.array, dtype=dtype) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/core/indexing.py", line 516, in array return np.asarray(array[self.key], dtype=None) File "/usr/local/lib/python3.6/dist-packages/numpy/core/numeric.py", line 538, in asarray return array(a, dtype, copy=False, order=order) File "/usr/local/lib/python3.6/dist-packages/xarray/coding/variables.py", line 69, in array return self.func(self.array) File "/usr/local/lib/python3.6/dist-packages/xarray/coding/variables.py", line 140, in _apply_mask return np.where(condition, decoded_fill_value, data) MemoryError

what i am geting Memory Error Regards

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Memory Error  642452713

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);
Powered by Datasette · Queries took 1999.585ms · About: xarray-datasette