Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CNPG DBConfig #2

Open
wants to merge 106 commits into
base: DB-update-2024-05-22
Choose a base branch
from
Open

CNPG DBConfig #2

wants to merge 106 commits into from

Conversation

yuyiguo
Copy link
Owner

@yuyiguo yuyiguo commented Jun 6, 2024

We updated DB configure based on what we learnt from the rucio DBs of DUNE and Belle 2 and general recommandations as well as Rubin use cases.

Thysk and others added 30 commits May 13, 2024 15:37
@Thysk
Add hermes section to server to prevent ActiveMQ message queuing in m…
2f22061 
…essages table
@Thysk
Add hermes section with used services_list into server values
44df417
@Thysk
Add opensearch values and make files to be incorperated into Rubin Ru…
7205ee6 
…cio build
@Thysk
Add opensearch to kustomization and makefiles
ebc0a7f
@Thysk
add opensearch version to makefile
703e04a
@Thysk
add opensearch repo to helm command
36ee360
@Thysk
uncomment ns.yaml in kustomization
9a5f770
@Thysk
Fix opensearch directory depth, and repo typo in top level prod kusto…
5f67052 
…mize
@Thysk
typo and added opensearch to apply
527d054
@Thysk
Merge branch 'slaclab:main' into add-opensearch
5fa43ce
@Thysk
Merge branch 'slaclab:main' into main
aed8d81
@Thysk
Merge branch 'slaclab:main' into Prevent-activeMQ-messages
18c3d8e
@Thysk
remove emptyDir from podSecurityPolicy.volumes
70258b5
@Thysk
remove secret that was unused in my deployment
c6a4414
@Thysk
reduce VmMaxMap count to match cluster
2be5da3
@Thysk
updated to use opensearch version 2.14
6a2cdfb
@bjwhite-fnal
Reenable HermesK and Kafka support. Needs both to work.
c7a6644
@bjwhite-fnal
Merge pull request #27 from bjwhite-fnal/main
c5ecf18 
Reenable HermesK and Kafka support. Needs both to work.
@bjwhite-fnal
Make patchfile naming consistent because I keep grepping for the wron…
80c2f73 
…g thing.
@bjwhite-fnal
Merge pull request #28 from bjwhite-fnal/main
b369804 
Make patchfile naming consistent because I keep grepping for the wrong thing.
@bjwhite-fnal
Merge pull request #24 from Thysk/Prevent-activeMQ-messages
a215d20 
Prevent ActiveMQ messages being generated by adding service_lists to server
@Thysk
enable sysctlInit to set sysctl settings using init container, and re…
cd458fe 
…set MaxMapCount to default
@Thysk
add sysctlInit and resetMaxMapCount to default
bce1d8e
@Thysk
Merge branch 'main' of https://github.com/Thysk/rubin-rucio-deploy in…
aa4418e 
…to main
@Thysk
change elastic_endpoint to opensearch cluster, add use_ssl to false f…
3e9b17a 
…or messaging-hermes
@Thysk
change the RUCIO_CFG_HERMES_ELASTIC_USERNAME to match the opensearch …
dd5084c 
…username
@Thysk
make change to server elastic_endpoint as well
709104f
@bjwhite-fnal
Testing most recent version of HermesK
85be30a
@bjwhite-fnal
Add env var to turn on HermesK.
3122984
@bjwhite-fnal
Merge pull request #25 from Thysk/add-opensearch
983b8f9 
Add OpenSearch to Rubin Cluster
bjwhite-fnal and others added 30 commits October 8, 2024 07:33
@bjwhite-fnal
Merge pull request #47 from bjwhite-fnal/main
9437515 
Increase Hermes chunk size.
@bjwhite-fnal
Update Hermes bulk further.
90e340e
@bjwhite-fnal
Merge pull request #48 from bjwhite-fnal/main
5eb51f5 
Update Hermes bulk further.
@bjwhite-fnal
Adjust kafka Topic config. Increase PVCs to 5G for Kafka.
e599693
@bjwhite-fnal
Merge pull request #49 from bjwhite-fnal/main
0028120 
Adjust kafka Topic config. Increase PVCs to 5G for Kafka.
@bjwhite-fnal
Fix typo in automatix config.
32c30fb
@bjwhite-fnal
Merge pull request #50 from bjwhite-fnal/main
dc5c894 
Fix typo in automatix config.
@bjwhite-fnal
Move prod logstash directory to match dev.
70bb175
@bjwhite-fnal
Remove unused Elasticsearch deployment. Exists in its own vCluster now.
f5e6e2f
@bjwhite-fnal
Merge pull request #51 from bjwhite-fnal/main
25f10bc 
Updates to elastic directories.
@yuyiguo
connect dve db to pg16 DB and disabled pg14.
07e3daf
@bjwhite-fnal
Merge pull request #53 from yuyiguo/pg16dev
58ba251 
connect dve db to pg16 DB and disabled pg14.
@bjwhite-fnal
Remove cruft.
27eb3be
@bjwhite-fnal
Remove Elastic stuff from dev makefile.
3a6eb59
@bjwhite-fnal
Remove elastic stuff from dev.
5a0c831
@bjwhite-fnal
Sync up.
b367723
@bjwhite-fnal
Merge pull request #54 from bjwhite-fnal/main
e98b4d0 
Sync up.
@bjwhite-fnal
Fix postgres/kustomization.yaml namespace.
49212a2
@bjwhite-fnal
Merge pull request #55 from bjwhite-fnal/main
59cc3b8 
Fix postgres/kustomization.yaml namespace.
@bjwhite-fnal
Update DB cluster/pooler to have 16 in name, so we don't start a seco…
082e149 
…nd cluster.
@bjwhite-fnal
Merge pull request #56 from bjwhite-fnal/main
bbb7b81 
Update DB cluster/pooler to have 16 in name, so we don't start a seco…
@bjwhite-fnal
Fix the CNPG DB container image.
ec61036
@bjwhite-fnal
Merge pull request #57 from bjwhite-fnal/main
7a3a496 
Fix the CNPG DB container image.
@bjwhite-fnal
Increase production Postgres replicas to 3.
cfeed63
@bjwhite-fnal
Upgrade dev to 35.6.0
f1e3011
@bjwhite-fnal
Upgrade prod to 35.6.0
45a865a
@bjwhite-fnal
Update prod Kafka bootstrap URL for HermesK.
49a571c
@bjwhite-fnal
Increase KafkaTopic retention period to 6 hours.
5181a0e
@bjwhite-fnal
Update HermesK to 35.6.0.1
915a1dd
@bjwhite-fnal
Pin production Kafka bootstrap IP.
00ba427
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@yuyiguo @Thysk @bjwhite-fnal @s-sajid-ali