Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DevOps routine tasks #252

Closed
DaMandal0rian opened this issue Feb 5, 2024 · 5 comments
Closed

DevOps routine tasks #252

DaMandal0rian opened this issue Feb 5, 2024 · 5 comments
Assignees
@DaMandal0rian

Comments

@DaMandal0rian
Copy link
Contributor

DaMandal0rian commented Feb 5, 2024 •
edited
Loading

No description provided.

@DaMandal0rian DaMandal0rian self-assigned this Feb 5, 2024
@DaMandal0rian DaMandal0rian converted this from a draft issue Feb 5, 2024
@DaMandal0rian
Copy link
Contributor Author

DaMandal0rian commented Feb 5, 2024 •
edited
Loading

Week: Jan 29 - Feb 05

  • MacOS runners AWS: fix disk size issue and create backup AMI image and snapshot
  • Fix Bootstrap nodes instability
    • Tuning kernel and network parameters
    • testing connectivity with IPv4/v6 and debugging
    • Fix memory overload issues and periodic crashes
  • Add pre-hook to clear cargo caches for runners
  • update runners latest OS packages
  • update infra gemini-3g latest release
  • upgrade Loki grafana stack and fix log retention bug
  • fix trivy workflow add delay mechanism for trivy scan job subspace#2506

@DaMandal0rian
Copy link
Contributor Author

DaMandal0rian commented Feb 19, 2024 •
edited
Loading

Week: Feb 05 - Feb 19

  • Migrate bootstrap nodes to Hetzner
  • Finished hetzner macOS runners configuration
  • Fix instability with Gemini-3h squid
  • Migrate Timekeepers for gemini-3g and gemini-3h
  • Add alerts for gemini-3h squids and archive
  • Add space-acres azure configuration to key vault and code signing
  • rollout gemini releases

@DaMandal0rian
Copy link
Contributor Author

DaMandal0rian commented Feb 27, 2024 •
edited
Loading

Week Feb 20 - 29

  • Resize disk volumes on machines (see attached)

Image

  • update runners
  • deploy blockscout and squid staging
  • resize disk space on 6 servers
  • mitigate netbiosd vulnerability on macOS machines

@DaMandal0rian
Copy link
Contributor Author

DaMandal0rian commented Mar 19, 2024 •
edited
Loading

Week Mar 01-Mar 15

  • test iterations of squids in staging and deployed to production
  • setup reward squid
  • Launch XDM devnet (2 iterations)
  • Server updates and GH runner updates
  • Fix blockscout on gemini-3g by updating to latest branch
  • Gemini-3h release upgrades mar-05/11/14

@DaMandal0rian
Copy link
Contributor Author

DaMandal0rian commented Mar 20, 2024 •
edited
Loading

Week Mar 18-Mar

  • switch nova domain to gemini-3h blockscout
  • Gemini-3h release upgrades mar-18

@github-project-automation github-project-automation bot moved this from EPIC to Done in DevOps Oct 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@DaMandal0rian DaMandal0rian

Labels
None yet
Projects
DevOps
Status: Done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@DaMandal0rian