New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spot instances #10

Open

thodson-usgs opened this issue Jan 11, 2024 · 2 comments

Contributor

thodson-usgs commented Jan 11, 2024

Has anyone investigated using spot instances? If not, I would.

For example,
https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/jobruns-flink-decommission.html

Collaborator

yuvipanda commented Jan 11, 2024

Nope, but I think they sound like a great idea.

thodson-usgs mentioned this issue

Enable spot instances #11

Merged

Contributor Author

thodson-usgs commented Jan 28, 2024

#11 enables spot instances
#14 discusses the two main configurations necessary to make Flink failure tolerant

a restart strategy for task manager failures.
a shared store for metadata used to recover from job manager failures

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment