Think through fallbacks for possible election night failures

[alykat]

Notes from 2022: https://docs.google.com/document/d/1bSBfuY-Ud27LVCL0PCMPzCYwXHRWtKpqG73U0v1cAd4/edit

Anything we should update? Consider differently?

---

Things that came out of the team conversation:

• Update server documentation #249
  • What kinds of update require a server restart, what requires a redeploy, what gets updated every time the rig runs
  • How to monitor logs and what to look for
  • How to check and clear disk space on the server
  • How to use your own computer to deploy to S3 (if EC2 goes down)
  • How to use your own computer to upload files to EC2 (if Github goes down)
• Set up a stable branch for deploys to prod, and define team best practices for new code pushes / deployments #248
• Fallbacks: Set up a backup server in a different region #246
• Fallbacks: Backup process for AP datafiles and configs #245
• Document how the components work #247