-
Notifications
You must be signed in to change notification settings - Fork 245
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
bump results watcher watcher container to 3Gi (#3093)
Over the course of about a week we have seen the results watcher on prd-rh01 have to OOM about once a day. During the day, we have observed garbage collection, and seen mem usage go up and down some. But as prd-rh01 is our most used cluster, it is the one that has bumped into the 2Gi limit too often. The other 3 clusters, while still having activity, have not observed leak behavior. We have engaged upstream with some profiling data from our personal clusters to see if there is some sort of edge case. But the simpler step first step to bump prod, and then continue to monitor, and see if we have just hit a new limit with more onboarding.
- Loading branch information
1 parent
14f1eda
commit 33340b5
Showing
4 changed files
with
11 additions
and
2 deletions.
There are no files selected for viewing
4 changes: 4 additions & 0 deletions
4
components/pipeline-service/production/base/bump-results-watcher-mem.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
--- | ||
- op: replace | ||
path: /spec/template/spec/containers/1/resources/limits/memory | ||
value: "3Gi" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -1514,7 +1514,7 @@ spec: | |
resources: | ||
limits: | ||
cpu: 250m | ||
memory: 2Gi | ||
memory: 3Gi | ||
requests: | ||
cpu: 100m | ||
memory: 64Mi | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -1514,7 +1514,7 @@ spec: | |
resources: | ||
limits: | ||
cpu: 250m | ||
memory: 2Gi | ||
memory: 3Gi | ||
requests: | ||
cpu: 100m | ||
memory: 64Mi | ||
|