Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance Shift(s): 687f4a7a #5442

Closed
github-actions bot opened this issue Aug 22, 2023 · 1 comment
Closed

Performance Shift(s): 687f4a7a #5442

github-actions bot opened this issue Aug 22, 2023 · 1 comment
Labels
Bot A bot generated issue/pull-request Type: Performance

Comments

@github-actions
Copy link
Contributor

Benchmark comparison has identified performance shifts at:

Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:

Performance Benchmark Report: 687f4a7

Performance shifts
       before           after         ratio
     [ff897eb3]       [687f4a7a]
     <main~1>         <main>    
+      53.9609375      70.30859375     1.30  experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500)
Full benchmark results

Benchmarks that have stayed the same:

       before           after         ratio
     [ff897eb3]       [687f4a7a]
     <main~1>         <main>    
              n/a              n/a      n/a  aux_factory.FactoryCommon.time_create
       6.97±0.1μs       7.05±0.2μs     1.01  aux_factory.HybridHeightFactory.time_create
       7.63±0.3μs       7.79±0.6μs     1.02  coords.AncillaryVariable.time_create
          617±7ns          610±6ns     0.99  coords.AuxCoord.time_bounds
       13.6±0.4μs       13.5±0.5μs     0.99  coords.AuxCoord.time_create
         624±20ns          608±6ns     0.97  coords.AuxCoord.time_points
         370±20μs         370±50μs     1.00  coords.AuxCoordLazy.time_bounds
       17.9±0.5μs       17.9±0.6μs     1.00  coords.AuxCoordLazy.time_create
         373±30μs         368±20μs     0.99  coords.AuxCoordLazy.time_points
       8.22±0.2μs       8.65±0.5μs     1.05  coords.CellMeasure.time_create
      1.74±0.04μs       1.79±0.1μs     1.03  coords.CellMethod.time_create
              n/a              n/a      n/a  coords.CoordCommon.time_create
          149±4μs         155±20μs     1.04  coords.DimCoord.time_create
         47.7±1μs         48.4±2μs     1.02  coords.DimCoord.time_regular
          917±8ms         915±10ms     1.00  cube.Aggregation.time_aggregated_by
         50.5±1μs       50.6±0.8μs     1.00  cube.AncillaryVariable.time_add
         10.4±1μs       10.6±0.4μs     1.01  cube.AncillaryVariable.time_create
         61.4±1μs       60.5±0.4μs     0.99  cube.AuxCoord.time_add
       8.75±0.2μs       8.46±0.3μs     0.97  cube.AuxCoord.time_create
       9.45±0.3μs       9.25±0.1μs     0.98  cube.AuxCoord.time_return_coord_dims
       6.93±0.2μs       7.15±0.3μs     1.03  cube.AuxCoord.time_return_coords
       53.7±0.6μs       53.5±0.4μs     1.00  cube.AuxFactory.time_add
       11.3±0.2μs       11.4±0.2μs     1.01  cube.AuxFactory.time_create
       50.6±0.5μs         50.5±1μs     1.00  cube.CellMeasure.time_add
       10.6±0.3μs       10.5±0.2μs     0.99  cube.CellMeasure.time_create
       43.2±0.4μs         43.2±1μs     1.00  cube.CellMethod.time_add
       5.89±0.1μs       5.94±0.2μs     1.01  cube.CellMethod.time_create
              n/a              n/a      n/a  cube.ComponentCommon.time_add
              n/a              n/a      n/a  cube.ComponentCommon.time_create
          222±1ms          222±1ms     1.00  cube.Concatenate.time_concatenate
      5.29±0.04μs       5.50±0.2μs     1.04  cube.Cube.time_basic
       89.7±0.4ns         91.6±1ns     1.02  cube.Cube.time_rename
          201±3μs          200±2μs     0.99  cube.Equality.time_equality
        1.02±0.2s        988±100ms     0.97  cube.Merge.time_merge
         39.1±1μs         38.3±2μs     0.98  cube.MeshCoord.time_add(10000)
         41.1±2μs         40.1±2μs     0.98  cube.MeshCoord.time_add(1000000)
         36.4±1μs         36.5±1μs     1.00  cube.MeshCoord.time_add(6)
       17.1±0.3μs       16.9±0.7μs     0.99  cube.MeshCoord.time_create(10000)
       17.0±0.5μs         17.9±2μs     1.05  cube.MeshCoord.time_create(1000000)
       16.7±0.5μs       16.2±0.1μs     0.97  cube.MeshCoord.time_create(6)
         82.3±5μs         82.5±5μs     1.00  cube.MeshCoord.time_remove(10000)
         89.4±5μs         87.8±5μs     0.98  cube.MeshCoord.time_remove(1000000)
         81.6±6μs         82.4±5μs     1.01  cube.MeshCoord.time_remove(6)
       3.50±0.5ms       3.45±0.4ms     0.99  experimental.ugrid.Connectivity.time_create(1000000)
      2.40±0.04ms      2.38±0.03ms     0.99  experimental.ugrid.Connectivity.time_create(6)
         901±50ns         915±30ns     1.02  experimental.ugrid.Connectivity.time_indices(1000000)
         890±10ns         916±10ns     1.03  experimental.ugrid.Connectivity.time_indices(6)
         39.2±2ms         39.2±3ms     1.00  experimental.ugrid.Connectivity.time_location_lengths(1000000)
      3.66±0.05ms      3.59±0.04ms     0.98  experimental.ugrid.Connectivity.time_location_lengths(6)
         42.2±2ms         42.9±4ms     1.02  experimental.ugrid.Connectivity.time_validate_indices(1000000)
       5.48±0.2ms      5.30±0.06ms     0.97  experimental.ugrid.Connectivity.time_validate_indices(6)
       6.33±0.3ms       6.14±0.3ms     0.97  experimental.ugrid.ConnectivityLazy.time_create(1000000)
       4.27±0.1ms      4.16±0.09ms     0.98  experimental.ugrid.ConnectivityLazy.time_create(6)
          370±8μs          364±6μs     0.98  experimental.ugrid.ConnectivityLazy.time_indices(1000000)
         363±10μs          359±6μs     0.99  experimental.ugrid.ConnectivityLazy.time_indices(6)
         36.8±1ms         36.5±1ms     0.99  experimental.ugrid.ConnectivityLazy.time_location_lengths(1000000)
       4.09±0.1ms       4.06±0.2ms     0.99  experimental.ugrid.ConnectivityLazy.time_location_lengths(6)
         43.0±2ms         41.6±1ms     0.97  experimental.ugrid.ConnectivityLazy.time_validate_indices(1000000)
       5.90±0.2ms       5.73±0.1ms     0.97  experimental.ugrid.ConnectivityLazy.time_validate_indices(6)
         19.9±2μs       18.9±0.9μs     0.95  experimental.ugrid.Mesh.time_add_connectivities(1000000)
          379±7μs          366±6μs     0.97  experimental.ugrid.Mesh.time_add_connectivities(6)
       7.18±0.2μs       7.35±0.2μs     1.02  experimental.ugrid.Mesh.time_add_coords(1000000)
      6.99±0.05μs       6.99±0.2μs     1.00  experimental.ugrid.Mesh.time_add_coords(6)
       7.83±0.3μs       7.79±0.3μs     1.00  experimental.ugrid.Mesh.time_connectivities(1000000)
       7.55±0.1μs      7.47±0.07μs     0.99  experimental.ugrid.Mesh.time_connectivities(6)
       8.93±0.4μs       8.94±0.3μs     1.00  experimental.ugrid.Mesh.time_coords(1000000)
       8.78±0.7μs      8.53±0.08μs     0.97  experimental.ugrid.Mesh.time_coords(6)
         62.1±1μs         63.2±2μs     1.02  experimental.ugrid.Mesh.time_create(1000000)
          449±4μs          445±6μs     0.99  experimental.ugrid.Mesh.time_create(6)
          161±2ms          156±9ms     0.97  experimental.ugrid.Mesh.time_eq(1000000)
          402±6μs          394±6μs     0.98  experimental.ugrid.Mesh.time_eq(6)
       7.60±0.3μs       7.48±0.6μs     0.98  experimental.ugrid.Mesh.time_remove_connectivities(1000000)
       7.58±0.1μs      7.26±0.05μs     0.96  experimental.ugrid.Mesh.time_remove_connectivities(6)
       11.2±0.8μs       11.1±0.2μs     0.99  experimental.ugrid.Mesh.time_remove_coords(1000000)
       11.2±0.2μs       10.9±0.2μs     0.97  experimental.ugrid.Mesh.time_remove_coords(6)
       20.8±0.7μs       20.4±0.7μs     0.98  experimental.ugrid.MeshCoord.time_bounds(10000)
          312±8ms          308±9ms     0.99  experimental.ugrid.MeshCoord.time_bounds(1000000)
       8.09±0.3μs       7.99±0.2μs     0.99  experimental.ugrid.MeshCoord.time_bounds(6)
      5.29±0.09ms      5.23±0.06ms     0.99  experimental.ugrid.MeshCoord.time_create(10000)
       5.37±0.2ms       5.37±0.3ms     1.00  experimental.ugrid.MeshCoord.time_create(1000000)
          302±4μs          291±3μs     0.96  experimental.ugrid.MeshCoord.time_create(6)
       6.39±0.2μs       6.34±0.2μs     0.99  experimental.ugrid.MeshCoord.time_points(10000)
       8.37±0.2μs       8.28±0.2μs     0.99  experimental.ugrid.MeshCoord.time_points(1000000)
      4.42±0.07μs      4.24±0.04μs     0.96  experimental.ugrid.MeshCoord.time_points(6)
       12.5±0.4ms       12.2±0.5ms     0.98  experimental.ugrid.MeshCoordLazy.time_bounds(10000)
          304±4ms         307±10ms     1.01  experimental.ugrid.MeshCoordLazy.time_bounds(1000000)
       17.4±0.7μs       17.5±0.9μs     1.01  experimental.ugrid.MeshCoordLazy.time_bounds(6)
       5.36±0.1ms       5.27±0.1ms     0.98  experimental.ugrid.MeshCoordLazy.time_create(10000)
       5.41±0.2ms       5.34±0.1ms     0.99  experimental.ugrid.MeshCoordLazy.time_create(1000000)
         354±10μs          348±9μs     0.98  experimental.ugrid.MeshCoordLazy.time_create(6)
       4.77±0.3ms       4.63±0.3ms     0.97  experimental.ugrid.MeshCoordLazy.time_points(10000)
       9.90±0.4ms       9.85±0.5ms     0.99  experimental.ugrid.MeshCoordLazy.time_points(1000000)
       12.3±0.7μs       12.3±0.8μs     1.00  experimental.ugrid.MeshCoordLazy.time_points(6)
         52.5±8μs         51.3±6μs     0.98  experimental.ugrid.MeshLazy.time_add_connectivities(1000000)
          458±8μs         456±20μs     1.00  experimental.ugrid.MeshLazy.time_add_connectivities(6)
         30.9±4μs         31.4±3μs     1.01  experimental.ugrid.MeshLazy.time_add_coords(1000000)
         28.2±1μs         27.7±2μs     0.98  experimental.ugrid.MeshLazy.time_add_coords(6)
         28.5±3μs         29.2±4μs     1.02  experimental.ugrid.MeshLazy.time_connectivities(1000000)
       28.5±0.9μs         29.0±1μs     1.02  experimental.ugrid.MeshLazy.time_connectivities(6)
         33.1±5μs         33.2±3μs     1.00  experimental.ugrid.MeshLazy.time_coords(1000000)
         33.3±1μs         32.4±1μs     0.97  experimental.ugrid.MeshLazy.time_coords(6)
         129±20μs         124±20μs     0.97  experimental.ugrid.MeshLazy.time_create(1000000)
         532±20μs          523±8μs     0.98  experimental.ugrid.MeshLazy.time_create(6)
          166±7ms          158±6ms     0.95  experimental.ugrid.MeshLazy.time_eq(1000000)
         538±20μs         512±10μs     0.95  experimental.ugrid.MeshLazy.time_eq(6)
         32.0±6μs         30.0±4μs     0.94  experimental.ugrid.MeshLazy.time_remove_connectivities(1000000)
         30.1±1μs         30.3±1μs     1.01  experimental.ugrid.MeshLazy.time_remove_connectivities(6)
         51.8±6μs         53.1±8μs     1.03  experimental.ugrid.MeshLazy.time_remove_coords(1000000)
         50.3±2μs         51.2±3μs     1.02  experimental.ugrid.MeshLazy.time_remove_coords(6)
              n/a              n/a      n/a  experimental.ugrid.UGridCommon.time_create(1000000)
              n/a              n/a      n/a  experimental.ugrid.UGridCommon.time_create(6)
          866±7ns         903±10ns     1.04  experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50)
          455±5ms          452±5ms     0.99  experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500)
              5.0              5.0     1.00  experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(50)
      46.84765625      46.60546875     0.99  experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(500)
       18.2±0.3ms       17.9±0.2ms     0.98  experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50)
       24.0±0.6ms       23.1±0.3ms     0.96  experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500)
              5.0              5.0     1.00  experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50)
              5.0              5.0     1.00  experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500)
          235±4ms          223±3ms     0.95  experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50)
       1.16±0.01s       1.16±0.01s     1.00  experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500)
        5.7578125              5.0     0.87  experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(50)
          159±2ms          161±3ms     1.01  experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50)
       1.07±0.01s       1.07±0.01s     1.01  experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500)
       5.03515625              5.0     0.99  experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(50)
         53.78125      54.37109375     1.01  experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(500)
  2.1752849999999997  2.1752849999999997     1.00  experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50)
  216.01528499999998  216.01528499999998     1.00  experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500)
      1.03±0.03ms          993±7μs     0.96  import_iris.Iris.time__concatenate
          286±8μs          275±4μs     0.96  import_iris.Iris.time__constraints
          142±1μs          146±6μs     1.03  import_iris.Iris.time__data_manager
        116±0.9μs          115±1μs     0.99  import_iris.Iris.time__deprecation
          151±2μs          151±6μs     1.00  import_iris.Iris.time__lazy_data
      1.41±0.02ms      1.37±0.01ms     0.97  import_iris.Iris.time__merge
         90.8±2μs         89.3±1μs     0.98  import_iris.Iris.time__representation
         840±20μs         804±10μs     0.96  import_iris.Iris.time_analysis
         220±10μs          217±3μs     0.98  import_iris.Iris.time_analysis__area_weighted
         143±10μs          134±3μs     0.94  import_iris.Iris.time_analysis__grid_angles
         376±10μs         374±10μs     0.99  import_iris.Iris.time_analysis__interpolation
         299±20μs          284±8μs     0.95  import_iris.Iris.time_analysis__regrid
          143±6μs          143±5μs     1.00  import_iris.Iris.time_analysis__scipy_interpolate
         201±20μs          187±9μs     0.93  import_iris.Iris.time_analysis_calculus
         507±30μs          498±5μs     0.98  import_iris.Iris.time_analysis_cartography
          111±3μs          105±2μs     0.94  import_iris.Iris.time_analysis_geomerty
          345±5μs          338±3μs     0.98  import_iris.Iris.time_analysis_maths
          110±2μs          106±1μs     0.97  import_iris.Iris.time_analysis_stats
          279±6μs          282±5μs     1.01  import_iris.Iris.time_analysis_trajectory
          480±5μs          477±4μs     0.99  import_iris.Iris.time_aux_factory
        100±0.8μs        100±0.6μs     1.00  import_iris.Iris.time_common
          250±7μs         245±30μs     0.98  import_iris.Iris.time_common_lenient
      1.50±0.02ms      1.49±0.02ms     1.00  import_iris.Iris.time_common_metadata
          193±6μs          192±5μs     1.00  import_iris.Iris.time_common_mixin
      1.70±0.01ms      1.69±0.02ms     0.99  import_iris.Iris.time_common_resolve
         298±10μs          293±3μs     0.99  import_iris.Iris.time_config
          155±6μs          148±5μs     0.95  import_iris.Iris.time_coord_categorisation
         535±10μs         537±20μs     1.00  import_iris.Iris.time_coord_systems
      1.12±0.06ms      1.09±0.02ms     0.98  import_iris.Iris.time_coords
         938±30μs         921±30μs     0.98  import_iris.Iris.time_cube
         411±30μs         386±10μs     0.94  import_iris.Iris.time_exceptions
         91.7±4μs         91.1±3μs     0.99  import_iris.Iris.time_experimental
          296±7μs         290±20μs     0.98  import_iris.Iris.time_fileformats
         375±10μs          368±5μs     0.98  import_iris.Iris.time_fileformats__ff
       4.48±0.2ms      4.28±0.09ms     0.96  import_iris.Iris.time_fileformats__ff_cross_references
         97.8±5μs         95.0±1μs     0.97  import_iris.Iris.time_fileformats__pp_lbproc_pairs
          155±9μs          148±5μs     0.96  import_iris.Iris.time_fileformats_abf
         603±10μs          590±7μs     0.98  import_iris.Iris.time_fileformats_cf
       7.02±0.2ms      6.99±0.08ms     1.00  import_iris.Iris.time_fileformats_dot
         88.4±2μs         87.9±1μs     0.99  import_iris.Iris.time_fileformats_name
          407±3μs          407±4μs     1.00  import_iris.Iris.time_fileformats_name_loaders
          148±2μs          150±4μs     1.02  import_iris.Iris.time_fileformats_netcdf
        165±0.9μs          165±5μs     1.00  import_iris.Iris.time_fileformats_nimrod
          314±3μs          315±3μs     1.00  import_iris.Iris.time_fileformats_nimrod_load_rules
      1.09±0.01ms      1.09±0.01ms     1.01  import_iris.Iris.time_fileformats_pp
          257±2μs          260±3μs     1.01  import_iris.Iris.time_fileformats_pp_load_rules
          176±6μs          176±7μs     1.00  import_iris.Iris.time_fileformats_pp_save_rules
          743±3μs          749±6μs     1.01  import_iris.Iris.time_fileformats_rules
          334±5μs          336±7μs     1.01  import_iris.Iris.time_fileformats_structured_array_identification
       98.1±0.8μs       98.4±0.6μs     1.00  import_iris.Iris.time_fileformats_um
         264±20μs          245±5μs     0.93  import_iris.Iris.time_fileformats_um__fast_load
          203±5μs          202±3μs     0.99  import_iris.Iris.time_fileformats_um__fast_load_structured_fields
         93.8±4μs       90.8±0.3μs     0.97  import_iris.Iris.time_fileformats_um__ff_replacement
          102±5μs        100±0.8μs     0.98  import_iris.Iris.time_fileformats_um__optimal_array_structuring
      1.55±0.04ms      1.55±0.04ms     1.00  import_iris.Iris.time_fileformats_um_cf_map
          193±8μs          187±6μs     0.97  import_iris.Iris.time_io
          275±6μs          276±4μs     1.00  import_iris.Iris.time_io_format_picker
         307±20μs          295±3μs     0.96  import_iris.Iris.time_iris
          183±6μs          183±7μs     1.00  import_iris.Iris.time_iterate
       12.6±0.2ms      12.1±0.07ms     0.96  import_iris.Iris.time_palette
          551±9μs         553±30μs     1.00  import_iris.Iris.time_plot
          130±4μs          127±2μs     0.98  import_iris.Iris.time_quickplot
       3.38±0.1ms      3.32±0.04ms     0.98  import_iris.Iris.time_std_names
      2.69±0.09ms      2.62±0.02ms     0.97  import_iris.Iris.time_symbols
         137±50ms        137±200ms     1.00  import_iris.Iris.time_tests
         337±10μs          316±2μs     0.94  import_iris.Iris.time_third_party_cartopy
       7.70±0.4ms       7.56±0.1ms     0.98  import_iris.Iris.time_third_party_cf_units
          138±6μs        130±0.4μs     0.94  import_iris.Iris.time_third_party_cftime
       4.35±0.2ms      4.29±0.05ms     0.99  import_iris.Iris.time_third_party_matplotlib
      1.76±0.03ms      1.73±0.01ms     0.98  import_iris.Iris.time_third_party_numpy
      3.06±0.03ms      3.05±0.02ms     1.00  import_iris.Iris.time_third_party_scipy
          125±3μs          119±2μs     0.96  import_iris.Iris.time_time
          506±3μs          498±6μs     0.98  import_iris.Iris.time_util
          112±1μs        112±0.4μs     0.99  iterate.IZip.time_izip
       11.0±0.3ms       10.8±0.6ms     0.98  load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF')
       38.2±0.6ms       37.7±0.8ms     0.99  load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF')
       12.0±0.3ms       11.7±0.4ms     0.98  load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP')
       10.7±0.1ms       10.6±0.1ms     0.99  load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF')
       33.0±0.7ms       32.8±0.2ms     0.99  load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF')
      11.8±0.09ms       11.7±0.2ms     0.99  load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP')
       1.80±0.02s          1.79±0s     0.99  load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF')
       30.9±0.4ms       30.4±0.6ms     0.98  load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF')
       2.00±0.01s       1.97±0.01s     0.98  load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP')
       1.80±0.01s       1.78±0.01s     0.99  load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF')
       31.2±0.6ms       30.9±0.7ms     0.99  load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF')
       1.99±0.02s       1.98±0.01s     1.00  load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP')
      5.18±0.06ms       5.13±0.2ms     0.99  load.LoadAndRealise.time_load((50, 50, 2), False, 'FF')
       30.6±0.6ms         30.8±1ms     1.01  load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF')
      5.55±0.09ms       5.49±0.2ms     0.99  load.LoadAndRealise.time_load((50, 50, 2), False, 'PP')
       5.26±0.2ms       5.09±0.1ms     0.97  load.LoadAndRealise.time_load((50, 50, 2), True, 'FF')
       30.3±0.5ms         30.8±2ms     1.02  load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF')
      5.53±0.05ms      5.43±0.07ms     0.98  load.LoadAndRealise.time_load((50, 50, 2), True, 'PP')
         55.5±1ms         56.8±1ms     1.02  load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF')
         43.4±1ms         44.1±1ms     1.01  load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF')
         20.8±2ms         20.4±3ms     0.98  load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP')
         53.3±3ms         51.3±3ms     0.96  load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF')
          110±3ms          109±2ms     0.99  load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF')
         53.0±2ms         52.0±3ms     0.98  load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP')
         533±20ms         521±20ms     0.98  load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF')
       5.16±0.6ms       5.44±0.7ms     1.05  load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF')
         546±20ms         539±20ms     0.99  load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP')
         542±10ms         533±10ms     0.98  load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF')
       5.46±0.8ms         5.77±1ms     1.06  load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF')
         542±10ms         548±20ms     1.01  load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP')
       2.01±0.2ms       2.06±0.2ms     1.02  load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF')
       5.39±0.9ms       5.23±0.4ms     0.97  load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF')
       2.00±0.3ms      2.01±0.09ms     1.01  load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP')
       2.08±0.1ms       2.11±0.2ms     1.01  load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF')
       5.23±0.5ms       5.57±0.9ms     1.07  load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF')
       2.04±0.1ms       2.05±0.2ms     1.00  load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP')
          521±4ms         525±10ms     1.01  load.ManyVars.time_many_var_load
       11.4±0.7ms       10.9±0.2ms     0.96  load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF')
       12.1±0.3ms       11.9±0.1ms     0.99  load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP')
       1.83±0.01s          1.82±0s     0.99  load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF')
       2.04±0.02s       2.02±0.01s     0.99  load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP')
       5.24±0.2ms      5.17±0.04ms     0.99  load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF')
       5.63±0.3ms       5.64±0.1ms     1.00  load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP')
       10.9±0.2ms      10.8±0.06ms     0.99  load.StructuredFF.time_structured_load((1280, 960, 5), False)
      6.30±0.09ms      6.10±0.06ms     0.97  load.StructuredFF.time_structured_load((1280, 960, 5), True)
       1.81±0.02s       1.79±0.01s     0.99  load.StructuredFF.time_structured_load((2, 2, 1000), False)
          445±1ms          441±2ms     0.99  load.StructuredFF.time_structured_load((2, 2, 1000), True)
       5.31±0.2ms      5.13±0.06ms     0.97  load.StructuredFF.time_structured_load((2, 2, 2), False)
      4.75±0.08ms      4.73±0.06ms     0.99  load.StructuredFF.time_structured_load((2, 2, 2), True)
         213±10ms        203±0.4ms     0.95  load.TimeConstraint.time_time_constraint(20, 'FF')
       35.5±0.5ms       34.8±0.6ms     0.98  load.TimeConstraint.time_time_constraint(20, 'NetCDF')
          231±8ms        222±0.7ms     0.96  load.TimeConstraint.time_time_constraint(20, 'PP')
       41.6±0.6ms       40.2±0.5ms     0.97  load.TimeConstraint.time_time_constraint(3, 'FF')
       35.5±0.8ms         34.9±1ms     0.98  load.TimeConstraint.time_time_constraint(3, 'NetCDF')
         45.4±3ms         43.1±1ms     0.95  load.TimeConstraint.time_time_constraint(3, 'PP')
         28.7±1ms       27.1±0.8ms     0.94  load.ugrid.BasicLoading.time_load_file(1)
         63.6±2ms         61.5±2ms     0.97  load.ugrid.BasicLoading.time_load_file(200000)
       22.3±0.5ms       21.3±0.9ms     0.96  load.ugrid.BasicLoading.time_load_mesh(1)
         37.9±1ms         36.3±2ms     0.96  load.ugrid.BasicLoading.time_load_mesh(200000)
         27.2±1ms       27.3±0.5ms     1.00  load.ugrid.BasicLoadingTime.time_load_file(1)
       32.2±0.8ms       32.3±0.8ms     1.00  load.ugrid.BasicLoadingTime.time_load_file(200000)
       22.6±0.7ms       22.5±0.7ms     1.00  load.ugrid.BasicLoadingTime.time_load_mesh(1)
       27.1±0.7ms       27.2±0.9ms     1.01  load.ugrid.BasicLoadingTime.time_load_mesh(200000)
         29.8±1ms         28.7±1ms     0.96  load.ugrid.Callback.time_load_file_callback(1)
         77.5±3ms         75.4±3ms     0.97  load.ugrid.Callback.time_load_file_callback(200000)
       29.0±0.5ms         29.0±1ms     1.00  load.ugrid.CallbackTime.time_load_file_callback(1)
       34.0±0.4ms         33.3±1ms     0.98  load.ugrid.CallbackTime.time_load_file_callback(200000)
       5.65±0.9ms       5.46±0.9ms     0.97  load.ugrid.DataRealisation.time_realise_data(10000)
         11.7±1ms         10.0±1ms     0.86  load.ugrid.DataRealisation.time_realise_data(200000)
         78.7±3ms         73.9±2ms     0.94  load.ugrid.DataRealisationTime.time_realise_data(10000)
       1.35±0.01s       1.34±0.02s     0.99  load.ugrid.DataRealisationTime.time_realise_data(200000)
          162±1ns          165±3ns     1.02  metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_fields
      1.38±0.01μs      1.40±0.02μs     1.01  metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_values
          165±2ns          164±2ns     0.99  metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_fields
      1.40±0.03μs      1.40±0.03μs     1.00  metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_values
          163±6ns          162±2ns     1.00  metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_fields
      1.63±0.03μs      1.58±0.02μs     0.97  metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_values
          164±3ns          163±2ns     0.99  metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_fields
      1.75±0.05μs      1.71±0.01μs     0.98  metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_values
          163±5ns          163±2ns     1.00  metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_fields
      1.60±0.04μs      1.59±0.01μs     1.00  metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_values
          162±6ns          161±1ns     1.00  metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_fields
      1.88±0.07μs      1.83±0.06μs     0.97  metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_values
      1.49±0.03μs      1.49±0.01μs     1.00  metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(1)
       10.9±0.2μs       11.1±0.2μs     1.02  metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(10)
          104±2μs        102±0.4μs     0.98  metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(100)
      1.52±0.04μs      1.52±0.01μs     1.00  metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(1)
       11.1±0.1μs       11.1±0.1μs     1.00  metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(10)
          103±3μs        102±0.8μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(100)
      1.59±0.04μs      1.57±0.01μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(1)
       11.8±0.4μs      11.7±0.08μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(10)
          110±2μs        109±0.8μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(100)
      1.64±0.06μs      1.65±0.03μs     1.00  metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(1)
       12.2±0.3μs       12.3±0.3μs     1.01  metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(10)
          116±2μs          118±2μs     1.02  metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(100)
      1.58±0.02μs      1.57±0.01μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(1)
       12.2±0.6μs       11.7±0.1μs     0.96  metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(10)
          112±2μs        109±0.3μs     0.98  metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(100)
      1.70±0.05μs      1.70±0.01μs     1.00  metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(1)
       12.8±0.3μs       13.1±0.2μs     1.02  metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(10)
          123±2μs        122±0.3μs     0.99  metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(100)
          169±6ns          172±5ns     1.02  mixin.CFVariableMixin.time_get_attributes
          171±4ns         169±10ns     0.99  mixin.CFVariableMixin.time_get_long_name
      1.47±0.03μs      1.49±0.03μs     1.01  mixin.CFVariableMixin.time_get_metadata
          170±4ns         170±10ns     1.00  mixin.CFVariableMixin.time_get_standard_name
          168±4ns         173±10ns     1.03  mixin.CFVariableMixin.time_get_units
         173±10ns         180±10ns     1.04  mixin.CFVariableMixin.time_get_var_name
      1.13±0.04μs      1.11±0.01μs     0.98  mixin.CFVariableMixin.time_set_attributes
          192±3ns         198±10ns     1.03  mixin.CFVariableMixin.time_set_long_name
       5.41±0.1μs       5.57±0.1μs     1.03  mixin.CFVariableMixin.time_set_metadata__dict
      6.91±0.09μs       7.06±0.3μs     1.02  mixin.CFVariableMixin.time_set_metadata__metadata
       6.83±0.2μs       6.74±0.2μs     0.99  mixin.CFVariableMixin.time_set_metadata__tuple
      1.03±0.03μs      1.03±0.03μs     0.99  mixin.CFVariableMixin.time_set_standard_name
          633±3ns         640±20ns     1.01  mixin.CFVariableMixin.time_set_units
          672±7ns         676±10ns     1.01  mixin.CFVariableMixin.time_set_var_name
         727±30ms         714±20ms     0.98  plot.AuxSort.time_aux_sort
          179±5ms          185±8ms     1.04  regridding.CurvilinearRegridding.time_regrid_pic
         618±10ms          611±8ms     0.99  regridding.HorizontalChunkedRegridding.time_regrid_area_w
         736±20ms         729±20ms     0.99  regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid
       5.90±0.2ms       5.60±0.3ms     0.95  save.NetcdfSave.time_netcdf_save_cube(50, False)
          171±4ms          169±6ms     0.99  save.NetcdfSave.time_netcdf_save_cube(50, True)
         59.0±3ms         59.6±4ms     1.01  save.NetcdfSave.time_netcdf_save_cube(600, False)
         857±20ms         853±10ms     1.00  save.NetcdfSave.time_netcdf_save_cube(600, True)
          139±2ns        137±0.4ns     0.99  save.NetcdfSave.time_netcdf_save_mesh(50, False)
          128±5ms          125±4ms     0.97  save.NetcdfSave.time_netcdf_save_mesh(50, True)
          138±3ns          139±2ns     1.01  save.NetcdfSave.time_netcdf_save_mesh(600, False)
         737±10ms          718±7ms     0.97  save.NetcdfSave.time_netcdf_save_mesh(600, True)
              5.0              5.0     1.00  save.NetcdfSave.track_addedmem_netcdf_save(50, False)
          10.4375       10.4453125     1.00  save.NetcdfSave.track_addedmem_netcdf_save(50, True)
              5.0              5.0     1.00  save.NetcdfSave.track_addedmem_netcdf_save(600, False)
      111.3671875     111.32421875     1.00  save.NetcdfSave.track_addedmem_netcdf_save(600, True)
         44.2±1ms         45.7±2ms     1.03  trajectory.TrajectoryInterpolation.time_trajectory_linear
          107±1ms          108±2ms     1.01  trajectory.TrajectoryInterpolation.time_trajectory_nearest

Benchmarks that have got worse:

       before           after         ratio
     [ff897eb3]       [687f4a7a]
     <main~1>         <main>    
+      53.9609375      70.30859375     1.30  experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500)

Generated by GHA run 5932309669

@github-actions github-actions bot added Bot A bot generated issue/pull-request Type: Performance labels Aug 22, 2023
@rcomer
Copy link
Member

rcomer commented Aug 22, 2023

Definitely noise.

@rcomer rcomer closed this as not planned Won't fix, can't repro, duplicate, stale Aug 22, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Aug 23, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Aug 30, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Sep 6, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Sep 13, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Sep 20, 2023
@scitools-ci scitools-ci bot removed this from 🚴 Peloton Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bot A bot generated issue/pull-request Type: Performance
Projects
None yet
Development

No branches or pull requests

1 participant