You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
These functions served us well, but haven't been used in fv3net for a while, mainly because it was difficult to extend run_kubernetes to support I/O patterns involving shared volumes. We have largely replaced use of run_kuberernetes with argo workflows as well as these composable functions for working with containers: https://github.com/VulcanClimateModeling/fv3net/blob/master/external/fv3kube/fv3kube/containers.py. In both cases, we have decomposed the process of running fv3 into a few steps
prepare the full fv3config.yml object from a shorter diff configuration
write the run directory
run the model
post process
Since each of these steps have very different requirements (e.g. 2 and 4 needs auth, but 3 does not) we now run them in separate containers.
IMO, for containerized workflows the role of fv3config is really isolated to step 2, so I think it would make sense to deprecate/remove run_kubernetes. Thoughts?
It is important to support run_native as a legacy option for testing purposes, and I'm not sure about run_docker for local development. I don't really use it, but others might.
The text was updated successfully, but these errors were encountered:
These functions served us well, but haven't been used in fv3net for a while, mainly because it was difficult to extend run_kubernetes to support I/O patterns involving shared volumes. We have largely replaced use of run_kuberernetes with argo workflows as well as these composable functions for working with containers: https://github.com/VulcanClimateModeling/fv3net/blob/master/external/fv3kube/fv3kube/containers.py. In both cases, we have decomposed the process of running fv3 into a few steps
Since each of these steps have very different requirements (e.g. 2 and 4 needs auth, but 3 does not) we now run them in separate containers.
IMO, for containerized workflows the role of fv3config is really isolated to step 2, so I think it would make sense to deprecate/remove
run_kubernetes
. Thoughts?It is important to support
run_native
as a legacy option for testing purposes, and I'm not sure aboutrun_docker
for local development. I don't really use it, but others might.The text was updated successfully, but these errors were encountered: