SBMTD Azure setup

[thekaveman]

Some tasks may need help from SBMTD IT.

Most of these tasks come from the notes doc when we did this with MST.

Azure basics

• Create Azure user group for Compiler, roles:
  • Application developer
• Add @angela-tran, @machikoyasuda, @thekaveman to group
• Create Subscription, assign Compiler group the Contributor role

Azure DevOps

• Create Azure DevOps organization
• Install Terraform extension on organization
• Create Azure DevOps project
• Turn off services not in use (Project settings > Overview > services) -- only Pipelines is used
• Add Compiler users (ideally via group)
• Create service connection
  • Type: Azure Resource Manager
  • Method: Service principal (automatic)
  • https://learn.microsoft.com/en-us/training/modules/authenticate-azure-deployment-pipeline-service-principals/
• Create pipeline by importing azure-pipelines.yml from this repo
  • Depends on Update azure-pipelines.yml with agency-specific variables #291
• Set environment variables
  • TF_IN_AUTOMATION=1
  • TF_VAR_DEPLOYER_APP_OBJECT_ID
  • TF_VAR_ENGINEERING_GROUP_OBJECT_ID
  • TF_VAR_AGENCY_CARD_DATA_ETL_APP_OBJECT_ID (renamed from TF_VAR_VELOCITY_ETL_APP_OBJECT_ID)
  • TF_VAR_IP_ADDRESS_WHITELIST_DEV/TEST/PROD
• Create Environment named "Approval"
• Setup nightly app restart for SBMTD server #362

Terraform

• (Manual) Create Resource Group and storage account dedicated to the Terraform state: sbmtd-mobility-pass-tf
• (Manual) Create container in storage account named tfstate
• (Manual x3 environments) Create environment Resource Group, Region: West US
  • sbmtd-mobility-pass-eligibility-dev
  • sbmtd-mobility-pass-eligibility-test
  • sbmtd-mobility-pass-eligibility-prod
• (Manual x3 environments) Create Terraform workspace
• Trigger a pipeline run to verify plan - https://dev.azure.com/sbmtd/eligibility-server/_build/results?buildId=7&view=results
• Trigger a pipeline run to verify apply
• Known chicken-and-egg: Terraform both creates the Key Vault and expects a secret within it, so will always fail on the first deploy

Application

• Create a keypair for the eligibility verification API
  • test
  • prod
• (x3 environments) Create settings.py with:
  • AGENCY_NAME
  • AUTH_HEADER
  • AUTH_TOKEN
  • CLIENT_KEY_PATH
  • IMPORT_FILE_PATH
  • SENTRY_DSN
  • SENTRY_TRACES_SAMPLE_RATE
• (x3 environments) Add settings.py and keys to storage account

[thekaveman]

We got stuck in SBMTD's Azure with an Azure AD issue, so the group for Compiler engineers is not yet created. SBMTD is going to work with their Azure consultant on this issue.

Most of the setup for Azure DevOps is complete, the remaining step of establishing a Service Connection depends on the fix for Azure AD.

[angela-tran]

• (Manual x3 environments) Create environment Resource Group, Region: West US
  • sbmtd-mobility-pass-dev
  • sbmtd-mobility-pass-test
  • sbmtd-mobility-pass-prod

Just noticed that our Terraform file expects this to be named sbmtd-mobility-pass-eligibility-dev, etc.:

eligibility-server/terraform/environment.tf

Line 8 in 1fd6140

name = "${var.AGENCY_RESOURCE_GROUP_PREFIX}-eligibility-${local.env_name}"

See the build failure at https://dev.azure.com/sbmtd/eligibility-server/_build/results?buildId=5&view=logs&j=ace7239b-ade7-5b52-2e3a-ab948f392fca&t=86fc3f94-fb9f-52ff-e1d4-fd3623140af8&l=22

I will recreate the Resource Groups to match this naming

[angela-tran]

For getting the values for TF_VAR_DEPLOYER_APP_OBJECT_ID and TF_VAR_DEPLOYER_APP_OBJECT_ID, make sure you go into the "Managed application in local directory" screen to get the Object ID

https://learn.microsoft.com/en-us/entra/identity-platform/app-objects-and-service-principals?tabs=browser#list-service-principals-associated-with-an-app

[thekaveman]

@angela-tran I think we are good to close this??

[angela-tran]

@thekaveman Yeah, I think so since all the infra is set up. The dev, test, and prod instances are just waiting for data, which isn't necessarily part of this issue

[thekaveman]

@angela-tran I wrote up this one earlier, I think we're covered 👍 cal-itp/benefits#1783