Try to setup provisioner infrastructure with Terraform Cloud

[mvgijssel]

ref #176

Tried a couple of modules/providers to setup a SSH tunnel to the Kubernetes cluster from Terraform Cloud but no luck so far.

Terraform provider jumphost does not work because of jaysonsantos/terraform-provider-jumphost#7, the provider is killed and takes the ssh connection with it. Does not work locally and Terraform Cloud.

The https://registry.terraform.io/modules/flaupretre/tunnel/ssh/latest module does not work because it always tries to authenticate with password instead of using the actual passed in identity file. Works with local execution.

The https://registry.terraform.io/providers/AndrewChubatiuk/ssh/latest/docs/data-sources/tunnel provider establishes a SSH connection but directly afterwards disconnects. This is also described in this issue AndrewChubatiuk/terraform-provider-ssh#10, but even the fork https://registry.terraform.io/providers/thecadams/ssh/latest does not work. Works with local execution.

[mvgijssel]

Configured the Terraform Cloud provisioner workspace with a working directory of stacks/provisioner to make sure everything in infrastructure/* gets uploaded as well.

[mvgijssel]

Disabled Unifi SSH access and enabled port forwarding to the provisioner SSH.

[mvgijssel]

Seemed the https://registry.terraform.io/modules/flaupretre/tunnel/ssh/latest module failed due to an invalid private key used! Generating a new one using

ssh-keygen -t rsa -m PEM

uploading that to Terraform Cloud and updating the provisioner authorized_keys resulted in a working deploy!

[mvgijssel]

Also tried a different key with https://registry.terraform.io/providers/thecadams/ssh/latest but unfortunately that did not work. Currently only https://registry.terraform.io/modules/flaupretre/tunnel/ssh/latest is working in Terraform Cloud remote execution.

[mvgijssel]

Let's create our own module ssh_tunnel using https://registry.terraform.io/modules/Invicton-Labs/shell-resource/external/latest which basically does:

1. Run SSH in the background and capture stdout / stderr in a file
2. Sleep for 5 seconds
3. Check if PID is still running
4. If running then echo log file and exit 0
5. If not running then echo log file and exit 1

[mvgijssel]

Going to try a different route with Pulumi.