home / github / issues

Menu
  • Search all tables
  • GraphQL API

issues: 1465230135

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association active_lock_reason draft pull_request body reactions performed_via_github_app state_reason repo type
1465230135 I_kwDOAMm_X85XVaM3 7324 Memory issues arising when trying to make dataArray values JSON serializable 83403825 closed 0     2 2022-11-26T18:54:06Z 2023-09-12T15:18:14Z 2023-09-12T15:18:13Z NONE      

What is your issue?

Need to return the data values in a JSON serializable format, calling .tolist and .to_dict consume so much memory that it produces a Memory Error

When trying to get the data values via the 2 methods above from a dataset the size of 831 MiBs the system memory being used jumped to 43 G before crashing (on a system of 64 G memory capacity). Producing a Memory Error

Need more memory efficient way of returning final data values.

Addressed in the following PR: https://github.com/pydata/xarray/pull/7323

{
    "url": "https://api.github.com/repos/pydata/xarray/issues/7324/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed 13221727 issue

Links from other tables

  • 1 row from issues_id in issues_labels
  • 1 row from issue in issue_comments
Powered by Datasette · Queries took 0.814ms · About: xarray-datasette