You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the moment the pipeline does a produce_or_load call from DrWatson.jl. This defaults to saving the produced dictionary of output from the inference as a JLD2 file.
JLD2 is a decent HDF5 format, so compresses nicely. However, it saves information about the types of the variables being serialised... and this means that if the underlying EpiAware types change due to package dev then deserialisation becomes difficult.
Its probably more robust to output to parquet.
The text was updated successfully, but these errors were encountered:
At the moment the pipeline does a
produce_or_load
call fromDrWatson.jl
. This defaults to saving the produced dictionary of output from the inference as aJLD2
file.JLD2
is a decentHDF5
format, so compresses nicely. However, it saves information about the types of the variables being serialised... and this means that if the underlyingEpiAware
types change due to package dev then deserialisation becomes difficult.Its probably more robust to output to parquet.
The text was updated successfully, but these errors were encountered: