home / github / issue_comments

Menu
  • GraphQL API
  • Search all tables

issue_comments: 286516988

This data as json

html_url issue_url id node_id user created_at updated_at author_association body reactions performed_via_github_app issue
https://github.com/pydata/xarray/issues/1308#issuecomment-286516988 https://api.github.com/repos/pydata/xarray/issues/1308 286516988 MDEyOklzc3VlQ29tbWVudDI4NjUxNjk4OA== 1217238 2017-03-14T18:29:55Z 2017-03-14T18:29:55Z MEMBER

I wonder if the fact that the data is highly compressed (short types converted to float64 with the scaled and offset attributes) can have an influence on dask performance and memory consumption? (especially the later)

Memory consumption, yes, performance, not so much. Scale/offset (de)compression can be applied super fast, unlike zlib compression which can be 10x slower than reading from disk.

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  214088387
Powered by Datasette · Queries took 0.789ms · About: xarray-datasette