Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 481: prior predictive analysis #489

Merged
merged 6 commits into from
Oct 10, 2024
Merged

Conversation

SamuelBrand1
Copy link
Collaborator

This PR closes #481.

This PR has a minor change to the prior predictive script, which was repeating the prior predictive analysis 4x.

Mainly this PR is adding a section to the manuscript supporting information describing the "first pass" priors and how for some combinations even prior predictive runs imply such large number of infections that we get InexactError exceptions in sampling to discrete outcomes.

To replicate locally run

% julia pipeline/scripts/run_priorpred_pipeline.jl 1000

and previewing or rendering the manuscript generates the following analysis of numbers of sucessful and failed prior predictive runs grouped by IGP and latent model.

Row infection_gen_proc latent_model n_success n_fail
1 EpiAware.EpiInfModels.DirectInfections ar 8 0
2 EpiAware.EpiInfModels.DirectInfections diff_ar 0 8
3 EpiAware.EpiInfModels.DirectInfections rw 8 0
4 EpiAware.EpiInfModels.ExpGrowthRate ar 0 8
5 EpiAware.EpiInfModels.ExpGrowthRate diff_ar 0 7
6 EpiAware.EpiInfModels.ExpGrowthRate rw 0 8
7 EpiAware.EpiInfModels.Renewal ar 17 7
8 EpiAware.EpiInfModels.Renewal diff_ar 0 24
9 EpiAware.EpiInfModels.Renewal rw 14 10

I think that the next steps are pretty straightforward, but thats out of scope for this PR.

@SamuelBrand1 SamuelBrand1 requested a review from seabbs October 9, 2024 22:05
@SamuelBrand1 SamuelBrand1 linked an issue Oct 9, 2024 that may be closed by this pull request
Copy link
Contributor

github-actions bot commented Oct 9, 2024

Try this Pull Request!

Open Julia and type:

import Pkg
Pkg.activate(temp=true)
Pkg.add(url="https://github.com/CDCgov/Rt-without-renewal", rev="481-prior-predictive-analysis", subdir="EpiAware")
using EpiAware

@SamuelBrand1
Copy link
Collaborator Author

Noting that julia-1.11 param recovery test is failing in CI for one param:

   latentprocess_type = EpiAware.EpiLatentModels.DiffLatentModel, epimodel = EpiAware.EpiInfModels.Renewal{EpiAware.EpiInfModels.EpiData{Float64, typeof(exp)}, Distributions.Normal{Float64}, EpiAware.EpiInfModels.ConstantRenewalStep{Float64}}(EpiAware.EpiInfModels.EpiData{Float64, typeof(exp)}([0.2, 0.5, 0.3], 3, exp), Distributions.Normal{Float64}(μ=4.605170185988092, σ=0.25), EpiAware.EpiInfModels.ConstantRenewalStep{Float64}([0.3, 0.5, 0.2])) |    2     1      3   5m44.2s
   param = latent.σ_AR                                                                                                                                                                                                                                                                                                                                                                                                                                          > |          1      1      1.4s

Context: This passed for julia-1.10 and julia-1.11 for Mac OSX. This could be stochastic failure (we test a large number of models and parameters in models)

seabbs
seabbs previously approved these changes Oct 10, 2024
Copy link
Collaborator

@seabbs seabbs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really nice. I like the idea of using index.qmd as the SI (we should make that clear)

@SamuelBrand1
Copy link
Collaborator Author

Since #491 has passed and in queue I'm merging modified CI into this.

@SamuelBrand1 SamuelBrand1 requested a review from seabbs October 10, 2024 12:53
@seabbs seabbs enabled auto-merge October 10, 2024 13:11
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.56%. Comparing base (21fb991) to head (40f1a27).
Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #489      +/-   ##
==========================================
- Coverage   90.02%   89.56%   -0.47%     
==========================================
  Files          57       51       -6     
  Lines         742      738       -4     
==========================================
- Hits          668      661       -7     
- Misses         74       77       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmarks:
    • Target: 10 Oct 2024 - 13:26
    • Baseline: 10 Oct 2024 - 13:53
  • Package commits:
    • Target: 7f4ebd
    • Baseline: fad045
  • Julia commits:
    • Target: 501a4f
    • Baseline: 501a4f
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.05 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 1.05 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.05 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 1.07 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 1.08 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 1.07 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 1.05 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.94 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 1.08 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 1.07 (5%) ❌ 1.00 (1%)
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.92 (5%) ✅ 1.00 (1%)
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Target

Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1     0 MHz       6698 s          0 s        556 s      14074 s          0 s
       #2     0 MHz       6201 s          0 s        522 s      14598 s          0 s
       #3     0 MHz       6988 s          0 s        550 s      13787 s          0 s
       #4     0 MHz       5755 s          0 s        523 s      15050 s          0 s
  Memory: 15.606491088867188 GB (13297.99609375 MB free)
  Uptime: 2138.57 sec
  Load Avg:  1.01  1.04  1.05
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1     0 MHz      10610 s          0 s        892 s      25957 s          0 s
       #2     0 MHz       9720 s          0 s        847 s      26885 s          0 s
       #3     0 MHz      10907 s          0 s        866 s      25688 s          0 s
       #4     0 MHz       9829 s          0 s        843 s      26789 s          0 s
  Memory: 15.606491088867188 GB (12929.4296875 MB free)
  Uptime: 3754.72 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 10 Oct 2024 - 13:26
  • Package commit: 7f4ebd
  • Julia commit: 501a4f
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 2.111 μs (5%) 416 bytes (1%) 10
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 289.506 ns (5%) 464 bytes (1%) 10
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 287.770 ns (5%) 464 bytes (1%) 10
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 421.685 ns (5%) 816 bytes (1%) 18
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 427.427 ns (5%) 816 bytes (1%) 18
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 10.029 μs (5%) 5.55 KiB (1%) 125
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.968 μs (5%) 5.55 KiB (1%) 125
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 492.773 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 503.580 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 184.233 ns (5%) 288 bytes (1%) 8
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 176.646 ns (5%) 288 bytes (1%) 8
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 266.432 ns (5%) 544 bytes (1%) 15
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 259.725 ns (5%) 544 bytes (1%) 15
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.948 μs (5%) 5.53 KiB (1%) 124
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.829 μs (5%) 5.53 KiB (1%) 124
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 493.340 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 501.139 ns (5%) 256 bytes (1%) 7
["EpiLatentModels", "AR", "evaluation", "linked"] 4.820 μs (5%) 4.19 KiB (1%) 91
["EpiLatentModels", "AR", "evaluation", "standard"] 4.447 μs (5%) 3.20 KiB (1%) 84
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 6.340 μs (5%) 12.20 KiB (1%) 108
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.991 μs (5%) 10.64 KiB (1%) 97
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 130.944 μs (5%) 54.77 KiB (1%) 1247
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 86.771 μs (5%) 40.47 KiB (1%) 917
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.052 μs (5%) 8.33 KiB (1%) 257
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.939 μs (5%) 7.20 KiB (1%) 221
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 918.810 ns (5%) 2.75 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 671.379 ns (5%) 1.88 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.298 μs (5%) 4.83 KiB (1%) 45
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.079 μs (5%) 3.95 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 48.751 μs (5%) 23.62 KiB (1%) 461
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.517 μs (5%) 16.55 KiB (1%) 353
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.881 μs (5%) 1.02 KiB (1%) 32
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.666 μs (5%) 1.02 KiB (1%) 32
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 22.432 μs (5%) 45.67 KiB (1%) 383
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 19.347 μs (5%) 31.16 KiB (1%) 339
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 50.483 μs (5%) 105.72 KiB (1%) 805
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 44.091 μs (5%) 75.84 KiB (1%) 709
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 167.150 μs (5%) 100.33 KiB (1%) 1607
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 118.440 μs (5%) 72.50 KiB (1%) 1240
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.292 μs (5%) 8.44 KiB (1%) 258
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 16.360 μs (5%) 7.31 KiB (1%) 222
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 42.649 μs (5%) 37.27 KiB (1%) 496
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 40.605 μs (5%) 28.83 KiB (1%) 466
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 43.811 μs (5%) 40.86 KiB (1%) 511
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 41.928 μs (5%) 32.42 KiB (1%) 481
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 124.501 μs (5%) 62.78 KiB (1%) 1021
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 101.739 μs (5%) 49.59 KiB (1%) 888
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.099 μs (5%) 2.20 KiB (1%) 60
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.863 μs (5%) 2.20 KiB (1%) 60
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 7.895 μs (5%) 5.55 KiB (1%) 102
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 7.426 μs (5%) 3.86 KiB (1%) 96
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 8.906 μs (5%) 13.92 KiB (1%) 115
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 8.496 μs (5%) 12.23 KiB (1%) 109
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 90.227 μs (5%) 39.72 KiB (1%) 833
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 70.862 μs (5%) 33.28 KiB (1%) 724
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.512 μs (5%) 2.27 KiB (1%) 59
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.302 μs (5%) 2.27 KiB (1%) 59
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 403.836 ns (5%) 1.03 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 309.331 ns (5%) 896 bytes (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.031 μs (5%) 5.12 KiB (1%) 23
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 910.700 ns (5%) 4.97 KiB (1%) 22
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.264 μs (5%) 19.03 KiB (1%) 381
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 28.052 μs (5%) 14.17 KiB (1%) 278
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.097 μs (5%) 608 bytes (1%) 9
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 931.742 ns (5%) 608 bytes (1%) 9
["EpiLatentModels", "Intercept", "evaluation", "linked"] 219.095 ns (5%) 400 bytes (1%) 10
["EpiLatentModels", "Intercept", "evaluation", "standard"] 207.422 ns (5%) 400 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 310.452 ns (5%) 704 bytes (1%) 17
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 297.008 ns (5%) 704 bytes (1%) 17
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 5.458 μs (5%) 3.62 KiB (1%) 87
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 5.327 μs (5%) 3.62 KiB (1%) 87
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 391.767 ns (5%) 208 bytes (1%) 4
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 393.667 ns (5%) 208 bytes (1%) 4
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.810 μs (5%) 3.56 KiB (1%) 40
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.625 μs (5%) 3.09 KiB (1%) 37
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.652 μs (5%) 7.66 KiB (1%) 49
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.389 μs (5%) 7.19 KiB (1%) 46
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 48.239 μs (5%) 21.42 KiB (1%) 406
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 31.519 μs (5%) 16.25 KiB (1%) 301
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.100 μs (5%) 608 bytes (1%) 9
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 928.516 ns (5%) 608 bytes (1%) 9
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 581.363 ns (5%) 1.72 KiB (1%) 21
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 431.455 ns (5%) 1.28 KiB (1%) 19
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.469 μs (5%) 8.11 KiB (1%) 32
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.303 μs (5%) 7.67 KiB (1%) 30
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 53.439 μs (5%) 25.52 KiB (1%) 504
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 36.178 μs (5%) 20.33 KiB (1%) 399
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.495 μs (5%) 1.33 KiB (1%) 32
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.361 μs (5%) 1.33 KiB (1%) 32
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 537.190 ns (5%) 1.25 KiB (1%) 20
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 407.860 ns (5%) 960 bytes (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 696.965 ns (5%) 1.78 KiB (1%) 29
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 567.054 ns (5%) 1.47 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 44.513 μs (5%) 18.31 KiB (1%) 387
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.692 μs (5%) 13.30 KiB (1%) 283
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.019 μs (5%) 352 bytes (1%) 9
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 841.271 ns (5%) 352 bytes (1%) 9
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 267.802 ns (5%) 448 bytes (1%) 12
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 251.610 ns (5%) 448 bytes (1%) 12
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 343.603 ns (5%) 768 bytes (1%) 19
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 339.315 ns (5%) 768 bytes (1%) 19
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 5.602 μs (5%) 3.93 KiB (1%) 95
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 5.615 μs (5%) 3.93 KiB (1%) 95
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 496.518 ns (5%) 160 bytes (1%) 4
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 498.974 ns (5%) 160 bytes (1%) 4
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 1.200 μs (5%) 3.73 KiB (1%) 43
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 900.783 ns (5%) 2.42 KiB (1%) 37
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.165 μs (5%) 9.80 KiB (1%) 54
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.813 μs (5%) 8.48 KiB (1%) 48
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 70.831 μs (5%) 34.69 KiB (1%) 702
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 51.305 μs (5%) 28.62 KiB (1%) 593
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 4.803 μs (5%) 1.23 KiB (1%) 32
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.691 μs (5%) 1.23 KiB (1%) 32
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 8.272 μs (5%) 5.78 KiB (1%) 113
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 7.647 μs (5%) 3.95 KiB (1%) 103
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 9.026 μs (5%) 8.98 KiB (1%) 130
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 8.299 μs (5%) 6.83 KiB (1%) 116
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 110.705 μs (5%) 42.25 KiB (1%) 861
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 68.106 μs (5%) 29.61 KiB (1%) 608
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.191 μs (5%) 1.83 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.626 μs (5%) 1.70 KiB (1%) 53
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.389 μs (5%) 3.61 KiB (1%) 64
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.320 μs (5%) 3.61 KiB (1%) 64
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.047 μs (5%) 3.95 KiB (1%) 73
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 3.943 μs (5%) 3.95 KiB (1%) 73
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 76.502 μs (5%) 38.80 KiB (1%) 919
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 59.941 μs (5%) 34.05 KiB (1%) 816
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.779 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.637 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 14.226 μs (5%) 22.08 KiB (1%) 412
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 14.126 μs (5%) 22.08 KiB (1%) 412
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 17.864 μs (5%) 22.30 KiB (1%) 419
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 17.813 μs (5%) 22.30 KiB (1%) 419
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 531.445 μs (5%) 293.05 KiB (1%) 7011
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 510.074 μs (5%) 288.30 KiB (1%) 6908
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 50.224 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 50.163 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.155 μs (5%) 400 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.114 μs (5%) 400 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.569 μs (5%) 624 bytes (1%) 17
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.573 μs (5%) 624 bytes (1%) 17
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 72.023 μs (5%) 35.95 KiB (1%) 903
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 57.126 μs (5%) 31.20 KiB (1%) 800
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.579 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.473 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.353 μs (5%) 1.83 KiB (1%) 30
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.032 μs (5%) 1.47 KiB (1%) 26
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.290 μs (5%) 7.78 KiB (1%) 43
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.555 μs (5%) 4.70 KiB (1%) 35
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 170.818 μs (5%) 86.44 KiB (1%) 1870
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 47.338 μs (5%) 29.38 KiB (1%) 727
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.059 μs (5%) 176 bytes (1%) 3
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.118 μs (5%) 176 bytes (1%) 3
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.716 μs (5%) 1.56 KiB (1%) 34
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.637 μs (5%) 1.56 KiB (1%) 34
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.803 μs (5%) 1.78 KiB (1%) 41
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.732 μs (5%) 1.78 KiB (1%) 41
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 27.471 μs (5%) 12.59 KiB (1%) 290
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 12.984 μs (5%) 7.84 KiB (1%) 187
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.125 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 968.625 ns (5%) 96 bytes (1%) 3
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 6.801 μs (5%) 5.81 KiB (1%) 117
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 6.702 μs (5%) 5.81 KiB (1%) 117
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.632 μs (5%) 6.16 KiB (1%) 126
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.531 μs (5%) 6.16 KiB (1%) 126
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 90.569 μs (5%) 49.09 KiB (1%) 1044
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 71.362 μs (5%) 44.34 KiB (1%) 941
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.195 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.019 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.138 μs (5%) 9.12 KiB (1%) 101
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 3.654 μs (5%) 7.88 KiB (1%) 93
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 6.143 μs (5%) 16.25 KiB (1%) 112
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.589 μs (5%) 15.00 KiB (1%) 104
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 108.000 μs (5%) 59.86 KiB (1%) 1165
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 89.527 μs (5%) 53.91 KiB (1%) 1055
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.362 μs (5%) 496 bytes (1%) 9
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.243 μs (5%) 496 bytes (1%) 9
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.415 μs (5%) 3.05 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 877.161 ns (5%) 1.48 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.806 μs (5%) 4.11 KiB (1%) 48
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.246 μs (5%) 2.55 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 38.191 μs (5%) 24.38 KiB (1%) 498
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 21.911 μs (5%) 17.39 KiB (1%) 366
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.182 μs (5%) 144 bytes (1%) 3
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.987 μs (5%) 144 bytes (1%) 3
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 425.317 ns (5%) 352 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 366.580 ns (5%) 352 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 550.027 ns (5%) 576 bytes (1%) 17
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 488.703 ns (5%) 576 bytes (1%) 17
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 31.779 μs (5%) 18.34 KiB (1%) 418
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 17.101 μs (5%) 12.92 KiB (1%) 296
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.879 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.634 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 29.775 μs (5%) 3.02 KiB (1%) 64
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 29.585 μs (5%) 2.70 KiB (1%) 62
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 19.256 μs (5%) 2.73 KiB (1%) 51
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 19.065 μs (5%) 2.42 KiB (1%) 49
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 62.736 μs (5%) 24.08 KiB (1%) 525
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.207 μs (5%) 18.34 KiB (1%) 401
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.151 μs (5%) 112 bytes (1%) 3
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.966 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1     0 MHz       6698 s          0 s        556 s      14074 s          0 s
       #2     0 MHz       6201 s          0 s        522 s      14598 s          0 s
       #3     0 MHz       6988 s          0 s        550 s      13787 s          0 s
       #4     0 MHz       5755 s          0 s        523 s      15050 s          0 s
  Memory: 15.606491088867188 GB (13297.99609375 MB free)
  Uptime: 2138.57 sec
  Load Avg:  1.01  1.04  1.05
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 10 Oct 2024 - 13:53
  • Package commit: fad045
  • Julia commit: 501a4f
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 2.100 μs (5%) 416 bytes (1%) 10
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 277.761 ns (5%) 464 bytes (1%) 10
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 285.831 ns (5%) 464 bytes (1%) 10
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 419.774 ns (5%) 816 bytes (1%) 18
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 418.663 ns (5%) 816 bytes (1%) 18
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 10.008 μs (5%) 5.55 KiB (1%) 125
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 10.009 μs (5%) 5.55 KiB (1%) 125
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 496.742 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 496.731 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 185.005 ns (5%) 288 bytes (1%) 8
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 177.396 ns (5%) 288 bytes (1%) 8
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 272.585 ns (5%) 544 bytes (1%) 15
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 262.940 ns (5%) 544 bytes (1%) 15
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 10.009 μs (5%) 5.53 KiB (1%) 124
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.898 μs (5%) 5.53 KiB (1%) 124
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 474.811 ns (5%) 256 bytes (1%) 7
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 489.318 ns (5%) 256 bytes (1%) 7
["EpiLatentModels", "AR", "evaluation", "linked"] 4.737 μs (5%) 4.19 KiB (1%) 91
["EpiLatentModels", "AR", "evaluation", "standard"] 4.378 μs (5%) 3.20 KiB (1%) 84
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 6.151 μs (5%) 12.20 KiB (1%) 108
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.692 μs (5%) 10.64 KiB (1%) 97
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 124.221 μs (5%) 54.77 KiB (1%) 1247
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 82.884 μs (5%) 40.47 KiB (1%) 917
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 16.982 μs (5%) 8.33 KiB (1%) 257
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.839 μs (5%) 7.20 KiB (1%) 221
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 949.436 ns (5%) 2.75 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 685.557 ns (5%) 1.88 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.269 μs (5%) 4.83 KiB (1%) 45
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.026 μs (5%) 3.95 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 48.160 μs (5%) 23.62 KiB (1%) 461
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.725 μs (5%) 16.55 KiB (1%) 353
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.902 μs (5%) 1.02 KiB (1%) 32
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.669 μs (5%) 1.02 KiB (1%) 32
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 22.431 μs (5%) 45.67 KiB (1%) 383
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 19.176 μs (5%) 31.16 KiB (1%) 339
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 51.075 μs (5%) 105.72 KiB (1%) 805
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 43.931 μs (5%) 75.84 KiB (1%) 709
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 159.877 μs (5%) 100.33 KiB (1%) 1607
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 111.006 μs (5%) 72.50 KiB (1%) 1240
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.583 μs (5%) 8.44 KiB (1%) 258
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 16.441 μs (5%) 7.31 KiB (1%) 222
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 42.118 μs (5%) 37.27 KiB (1%) 496
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 39.774 μs (5%) 28.83 KiB (1%) 466
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 43.591 μs (5%) 40.86 KiB (1%) 511
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 41.116 μs (5%) 32.42 KiB (1%) 481
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 115.214 μs (5%) 62.78 KiB (1%) 1021
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 95.408 μs (5%) 49.59 KiB (1%) 888
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.076 μs (5%) 2.20 KiB (1%) 60
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.880 μs (5%) 2.20 KiB (1%) 60
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 7.824 μs (5%) 5.55 KiB (1%) 102
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 7.364 μs (5%) 3.86 KiB (1%) 96
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 9.147 μs (5%) 13.92 KiB (1%) 115
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 8.466 μs (5%) 12.23 KiB (1%) 109
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 85.610 μs (5%) 39.72 KiB (1%) 833
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 68.778 μs (5%) 33.28 KiB (1%) 724
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.504 μs (5%) 2.27 KiB (1%) 59
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.238 μs (5%) 2.27 KiB (1%) 59
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 392.235 ns (5%) 1.03 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 296.265 ns (5%) 896 bytes (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.017 μs (5%) 5.12 KiB (1%) 23
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 898.333 ns (5%) 4.97 KiB (1%) 22
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 43.391 μs (5%) 19.03 KiB (1%) 381
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.902 μs (5%) 14.17 KiB (1%) 278
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.092 μs (5%) 608 bytes (1%) 9
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 914.390 ns (5%) 608 bytes (1%) 9
["EpiLatentModels", "Intercept", "evaluation", "linked"] 219.485 ns (5%) 400 bytes (1%) 10
["EpiLatentModels", "Intercept", "evaluation", "standard"] 215.438 ns (5%) 400 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 309.742 ns (5%) 704 bytes (1%) 17
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 301.687 ns (5%) 704 bytes (1%) 17
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 5.322 μs (5%) 3.62 KiB (1%) 87
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 5.291 μs (5%) 3.62 KiB (1%) 87
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 411.065 ns (5%) 208 bytes (1%) 4
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 409.260 ns (5%) 208 bytes (1%) 4
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.799 μs (5%) 3.56 KiB (1%) 40
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.602 μs (5%) 3.09 KiB (1%) 37
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.595 μs (5%) 7.66 KiB (1%) 49
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.348 μs (5%) 7.19 KiB (1%) 46
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 47.018 μs (5%) 21.42 KiB (1%) 406
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 31.479 μs (5%) 16.25 KiB (1%) 301
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.087 μs (5%) 608 bytes (1%) 9
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 915.757 ns (5%) 608 bytes (1%) 9
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 575.541 ns (5%) 1.72 KiB (1%) 21
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 437.783 ns (5%) 1.28 KiB (1%) 19
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.489 μs (5%) 8.11 KiB (1%) 32
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.351 μs (5%) 7.67 KiB (1%) 30
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 53.239 μs (5%) 25.52 KiB (1%) 504
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 35.826 μs (5%) 20.33 KiB (1%) 399
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.538 μs (5%) 1.33 KiB (1%) 32
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.324 μs (5%) 1.33 KiB (1%) 32
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 541.219 ns (5%) 1.25 KiB (1%) 20
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 410.860 ns (5%) 960 bytes (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 713.883 ns (5%) 1.78 KiB (1%) 29
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 559.800 ns (5%) 1.47 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 42.929 μs (5%) 18.31 KiB (1%) 387
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.571 μs (5%) 13.30 KiB (1%) 283
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.007 μs (5%) 352 bytes (1%) 9
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 818.694 ns (5%) 352 bytes (1%) 9
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 274.411 ns (5%) 448 bytes (1%) 12
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 262.543 ns (5%) 448 bytes (1%) 12
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 365.411 ns (5%) 768 bytes (1%) 19
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 357.024 ns (5%) 768 bytes (1%) 19
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 5.676 μs (5%) 3.93 KiB (1%) 95
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 5.615 μs (5%) 3.93 KiB (1%) 95
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 485.677 ns (5%) 160 bytes (1%) 4
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 482.533 ns (5%) 160 bytes (1%) 4
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 1.256 μs (5%) 3.73 KiB (1%) 43
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 923.760 ns (5%) 2.42 KiB (1%) 37
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.144 μs (5%) 9.80 KiB (1%) 54
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.795 μs (5%) 8.48 KiB (1%) 48
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 70.501 μs (5%) 34.69 KiB (1%) 702
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 51.255 μs (5%) 28.62 KiB (1%) 593
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 4.905 μs (5%) 1.23 KiB (1%) 32
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.749 μs (5%) 1.23 KiB (1%) 32
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 8.155 μs (5%) 5.78 KiB (1%) 113
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 7.584 μs (5%) 3.95 KiB (1%) 103
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 8.846 μs (5%) 8.98 KiB (1%) 130
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 8.159 μs (5%) 6.83 KiB (1%) 116
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 102.741 μs (5%) 42.25 KiB (1%) 861
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 63.548 μs (5%) 29.61 KiB (1%) 608
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.193 μs (5%) 1.83 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.597 μs (5%) 1.70 KiB (1%) 53
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.373 μs (5%) 3.61 KiB (1%) 64
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.285 μs (5%) 3.61 KiB (1%) 64
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.012 μs (5%) 3.95 KiB (1%) 73
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 3.954 μs (5%) 3.95 KiB (1%) 73
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 77.163 μs (5%) 38.80 KiB (1%) 919
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 60.443 μs (5%) 34.05 KiB (1%) 816
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.642 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.594 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 14.086 μs (5%) 22.08 KiB (1%) 412
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 14.086 μs (5%) 22.08 KiB (1%) 412
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 17.973 μs (5%) 22.30 KiB (1%) 419
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 17.803 μs (5%) 22.30 KiB (1%) 419
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 527.660 μs (5%) 293.05 KiB (1%) 7011
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 508.165 μs (5%) 288.30 KiB (1%) 6908
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 50.154 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 50.805 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.131 μs (5%) 400 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.090 μs (5%) 400 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.708 μs (5%) 624 bytes (1%) 17
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.565 μs (5%) 624 bytes (1%) 17
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 71.953 μs (5%) 35.95 KiB (1%) 903
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 57.226 μs (5%) 31.20 KiB (1%) 800
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.762 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.557 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.375 μs (5%) 1.83 KiB (1%) 30
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.051 μs (5%) 1.47 KiB (1%) 26
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.079 μs (5%) 7.78 KiB (1%) 43
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.438 μs (5%) 4.70 KiB (1%) 35
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 166.480 μs (5%) 86.44 KiB (1%) 1870
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 47.298 μs (5%) 29.38 KiB (1%) 727
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.197 μs (5%) 176 bytes (1%) 3
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.163 μs (5%) 176 bytes (1%) 3
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.699 μs (5%) 1.56 KiB (1%) 34
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.642 μs (5%) 1.56 KiB (1%) 34
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.834 μs (5%) 1.78 KiB (1%) 41
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.743 μs (5%) 1.78 KiB (1%) 41
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 27.471 μs (5%) 12.59 KiB (1%) 290
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 13.115 μs (5%) 7.84 KiB (1%) 187
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.106 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 967.647 ns (5%) 96 bytes (1%) 3
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 6.801 μs (5%) 5.81 KiB (1%) 117
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 6.736 μs (5%) 5.81 KiB (1%) 117
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.592 μs (5%) 6.16 KiB (1%) 126
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.541 μs (5%) 6.16 KiB (1%) 126
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 90.378 μs (5%) 49.09 KiB (1%) 1044
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 71.393 μs (5%) 44.34 KiB (1%) 941
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.105 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.059 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.238 μs (5%) 9.12 KiB (1%) 101
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 3.787 μs (5%) 7.88 KiB (1%) 93
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 5.867 μs (5%) 16.25 KiB (1%) 112
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.524 μs (5%) 15.00 KiB (1%) 104
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 111.427 μs (5%) 59.86 KiB (1%) 1165
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 92.703 μs (5%) 53.91 KiB (1%) 1055
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.385 μs (5%) 496 bytes (1%) 9
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.223 μs (5%) 496 bytes (1%) 9
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.418 μs (5%) 3.05 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 895.068 ns (5%) 1.48 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.798 μs (5%) 4.11 KiB (1%) 48
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.230 μs (5%) 2.55 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 38.602 μs (5%) 24.38 KiB (1%) 498
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 21.991 μs (5%) 17.39 KiB (1%) 366
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.207 μs (5%) 144 bytes (1%) 3
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.980 μs (5%) 144 bytes (1%) 3
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 426.874 ns (5%) 352 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 368.942 ns (5%) 352 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 545.401 ns (5%) 576 bytes (1%) 17
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 486.390 ns (5%) 576 bytes (1%) 17
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 31.789 μs (5%) 18.34 KiB (1%) 418
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 16.942 μs (5%) 12.92 KiB (1%) 296
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.865 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.608 μs (5%) 96 bytes (1%) 3
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 28.473 μs (5%) 3.02 KiB (1%) 64
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 28.212 μs (5%) 2.70 KiB (1%) 62
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 19.466 μs (5%) 2.73 KiB (1%) 51
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 19.296 μs (5%) 2.42 KiB (1%) 49
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 61.004 μs (5%) 24.08 KiB (1%) 525
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 40.916 μs (5%) 18.34 KiB (1%) 401
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.200 μs (5%) 112 bytes (1%) 3
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.015 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1     0 MHz      10610 s          0 s        892 s      25957 s          0 s
       #2     0 MHz       9720 s          0 s        847 s      26885 s          0 s
       #3     0 MHz      10907 s          0 s        866 s      25688 s          0 s
       #4     0 MHz       9829 s          0 s        843 s      26789 s          0 s
  Memory: 15.606491088867188 GB (12929.4296875 MB free)
  Uptime: 3754.72 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@seabbs seabbs added this pull request to the merge queue Oct 10, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Oct 10, 2024
@seabbs seabbs added this pull request to the merge queue Oct 10, 2024
@seabbs seabbs removed this pull request from the merge queue due to a manual request Oct 10, 2024
@seabbs seabbs force-pushed the 481-prior-predictive-analysis branch from 40f1a27 to 557844f Compare October 10, 2024 15:12
@seabbs seabbs merged commit f3751a6 into main Oct 10, 2024
8 of 9 checks passed
@seabbs seabbs deleted the 481-prior-predictive-analysis branch October 10, 2024 15:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Analysis of what is causing models to break.
3 participants