home / github

Menu
  • Search all tables
  • GraphQL API

issue_comments

Table actions
  • GraphQL API for issue_comments

4 rows where user = 2014301 sorted by updated_at descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: issue_url, reactions, created_at (date), updated_at (date)

issue 2

  • Why is my export to netcdf command leading to a __truediv__ error? 3
  • Writing a netCDF file is unexpectedly slow 1

user 1

  • msaharia · 4 ✖

author_association 1

  • NONE 4
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions performed_via_github_app issue
485505651 https://github.com/pydata/xarray/issues/2912#issuecomment-485505651 https://api.github.com/repos/pydata/xarray/issues/2912 MDEyOklzc3VlQ29tbWVudDQ4NTUwNTY1MQ== msaharia 2014301 2019-04-22T18:32:30Z 2019-04-22T18:36:38Z NONE

Diagnosis

Thank you very much! I found this. For now, I will use the load() option.

Loading netCDFs

In [8]: time ncdat=reformat_LIS_outputs(outlist) CPU times: user 7.78 s, sys: 220 ms, total: 8 s Wall time: 8.02 s

Slower export

In [6]: time ncdat.to_netcdf('test_slow') CPU times: user 12min, sys: 8.19 s, total: 12min 9s Wall time: 12min 14s

Faster export

In [9]: time ncdat.load().to_netcdf('test_faster.nc') CPU times: user 42.6 s, sys: 2.82 s, total: 45.4 s Wall time: 54.6 s

{
    "total_count": 9,
    "+1": 5,
    "-1": 0,
    "laugh": 1,
    "hooray": 1,
    "confused": 0,
    "heart": 1,
    "rocket": 1,
    "eyes": 0
}
  Writing a netCDF file is unexpectedly slow 435535284
449217260 https://github.com/pydata/xarray/issues/2623#issuecomment-449217260 https://api.github.com/repos/pydata/xarray/issues/2623 MDEyOklzc3VlQ29tbWVudDQ0OTIxNzI2MA== msaharia 2014301 2018-12-21T02:13:51Z 2018-12-21T02:13:51Z NONE

Arrgh. You're right. Updated Pandas and Numpy and the error went away. Thanks a lot!

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Why is my export to netcdf command leading to a __truediv__ error? 392816513
449213052 https://github.com/pydata/xarray/issues/2623#issuecomment-449213052 https://api.github.com/repos/pydata/xarray/issues/2623 MDEyOklzc3VlQ29tbWVudDQ0OTIxMzA1Mg== msaharia 2014301 2018-12-21T01:57:51Z 2018-12-21T01:57:51Z NONE

Here it is:

``` xarray.Dataset { dimensions: hru = 17 ; time = 233 ;

variables: int64 hru(hru) ; datetime64[ns] time(time) ; float64 pptrate(time, hru) ; pptrate:long_name = precipitation rate (instant) ; pptrate:units = kg m-2 s-1 ; int64 hruId(hru) ; hruId:long_name = ID defining the hydrologic response unit (instant) ; hruId:units = - ; float64 averageInstantRunoff(time, hru) ; int32 nSnow(time, hru) ; nSnow:long_name = number of snow layers (instant) ; nSnow:units = - ; int32 nSoil(time, hru) ; nSoil:long_name = number of soil layers (instant) ; nSoil:units = - ; int32 nLayers(time, hru) ; nLayers:long_name = total number of layers (instant) ; nLayers:units = - ;

// global attributes: :summaVersion = v2.0.0 ; :buildTime = Mon Mar 26 17:11:28 MDT 2018 ; :gitBranch = develop-0-gcbbec4a ; :gitHash = cbbec4a639446a285366339f0a2a9680c7df1ed4 ; :soilStress = NoahType ; :stomResist = BallBerry ; :num_method = itertive ; :fDerivMeth = analytic ; :LAI_method = monTable ; :f_Richards = mixdform ; :groundwatr = bigBuckt ; :hc_profile = constant ; :bcUpprTdyn = nrg_flux ; :bcLowrTdyn = zeroFlux ; :bcUpprSoiH = liq_flux ; :bcLowrSoiH = drainage ; :veg_traits = CM_QJRMS1988 ; :canopyEmis = difTrans ; :snowIncept = lightSnow ; :windPrfile = logBelowCanopy ; :astability = louisinv ; :canopySrad = BeersLaw ; :alb_method = varDecay ; :snowLayers = CLM_2010 ; :compaction = anderson ; :thCondSnow = jrdn1991 ; :thCondSoil = funcSoilWet ; :spatial_gw = localColumn ; :subRouting = timeDlay ; :notPopulatedYet = notPopulatedYet ; }None ```

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Why is my export to netcdf command leading to a __truediv__ error? 392816513
449167848 https://github.com/pydata/xarray/issues/2623#issuecomment-449167848 https://api.github.com/repos/pydata/xarray/issues/2623 MDEyOklzc3VlQ29tbWVudDQ0OTE2Nzg0OA== msaharia 2014301 2018-12-20T23:13:43Z 2018-12-20T23:13:43Z NONE

@shoyer Thank you! Here it is:

Traceback (most recent call last): File "./concat.py", line 38, in <module> ncconcat.to_netcdf(os.path.join(ncdir, finalfile), 'w') File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/core/dataset.py", line 1222, in to_netcdf compute=compute) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/backends/api.py", line 718, in to_netcdf unlimited_dims=unlimited_dims) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/backends/api.py", line 761, in dump_to_store unlimited_dims=unlimited_dims) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/backends/common.py", line 261, in store variables, attributes = self.encode(variables, attributes) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/backends/common.py", line 347, in encode variables, attributes = cf_encoder(variables, attributes) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/conventions.py", line 573, in cf_encoder for k, v in iteritems(variables)) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/conventions.py", line 573, in <genexpr> for k, v in iteritems(variables)) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/conventions.py", line 235, in encode_cf_variable var = coder.encode(var, name=name) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/coding/times.py", line 395, in encode encoding.pop('calendar', None)) File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/xarray/coding/times.py", line 365, in encode_cf_datetime num = (pd.DatetimeIndex(dates.ravel()) - ref_date) / time_delta File "/glade/u/home/manab/anaconda3/lib/python3.6/site-packages/pandas/core/indexes/base.py", line 3885, in invalid_op "{typ}".format(name=name, typ=type(self))) TypeError: cannot perform __truediv__ with this index type: <class 'pandas.core.indexes.datetimes.DatetimeIndex'>

{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  Why is my export to netcdf command leading to a __truediv__ error? 392816513

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [performed_via_github_app] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
);
CREATE INDEX [idx_issue_comments_issue]
    ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
    ON [issue_comments] ([user]);
Powered by Datasette · Queries took 17.108ms · About: xarray-datasette