Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make Finalize.wdl tasks volatile #414

Open
jamesemery opened this issue Aug 7, 2023 · 0 comments
Open

Make Finalize.wdl tasks volatile #414

jamesemery opened this issue Aug 7, 2023 · 0 comments

Comments

@jamesemery
Copy link
Collaborator

I was using some tasks from here: https://github.com/broadinstitute/long-read-pipelines/blob/dc2cd65fe18e9301925f88cc79a3db601cd38029/wdl/tasks/Utility/Finalize.wdl (specifically FinalizeToDir) and I ran into some esoteric cases where call-caching was failing to re-upload results even when the underlying files had been updated. While the issues with call-caching might or might not be relevant here I actually think all of the upload tasks in that WDL should be labeled as meta { volatile: true } since their behavior depends on the status of files in the output folder which is not checked by cromwell for call-caching, so they should not be call-caching lest the state of the output folder be incorrect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant