Gruntwork Pipelines using wrong terraform version #789

jeffreymlewis · 2023-12-05T01:37:24Z

jeffreymlewis
Dec 5, 2023

I've finally got Gruntwork Pipelines running. However, it's using the wrong version of terraform (see below). What is the correct way to use a specific terraform version in Pipelines? I tried using the .gruntwork/config.yml file in infra-live, resulting in the output below.

(.gruntwork/config.yml)

pipelines:
  cli-version: v0.2.4
  terraform-version: 1.5.5
  terragrunt-version: 0.50.14

Installing Terraform v1.5.5
Downloading release tarball from https://releases.hashicorp.com/terraform/1.5.5/terraform_1.5.5_linux_amd64.zip
#=#=#                                                                         

                                                                           0.0%
                                                                           0.1%
#                                                                          2.5%
###                                                                        5.1%
###################                                                       27.7%
###########################                                               37.7%
###################################                                       49.9%
######################################                                    53.9%
#############################################                             63.6%
#####################################################                     74.1%
#############################################################             85.1%
######################################################################## 100.0%
Downloading SHA hash file from https://releases.hashicorp.com/terraform/1.5.5/terraform_1.5.5_SHA256SUMS
Not instructed to use Local PGP (/home/runner/.tfenv/use-{gpgv,gnupg}) & No keybase install found, skipping OpenPGP signature verification
Archive:  /tmp/tfenv_download.u8wWoG/terraform_1.5.5_linux_amd64.zip
  inflating: /home/runner/.tfenv/versions/1.5.5/terraform  
Installation of terraform v1.5.5 successful. To make this your default version, run 'tfenv use 1.5.5'
Switching default version to v1.5.5
Default version (when not overridden by .terraform-version or TFENV_TERRAFORM_VERSION) is now: 1.5.5
2023/12/05 01:21:36 Creating directory for terragrunt: /home/runner/.terragrunt.versions/
Downloading https://github.com/gruntwork-io/terragrunt/releases/download/v0.50.14/terragrunt_linux_amd64 to terragrunt_linux_amd64
Downloading ...
47453543 bytes downloaded.
Switched terragrunt to version "0.50.14" 
Run dsaltares/[email protected]
Run sudo mv /tmp/pipelines /usr/local/bin/pipelines
Run echo "MACHINE_USER_NAME=$(gh api /user | jq .login)" >> "$GITHUB_OUTPUT"
Run # CD Infra-live directory && Run Pipelines-execute
time="2023-12-05T01:21:39Z" level=info msg="This program sends telemetry to Gruntwork. To disable, set PIPELINES_TELEMETRY_OPT_OUT=true as an environment variable" binary=pipelines version=v0.2.4
time="2023-12-05T01:21:39Z" level=info msg="Configuring git to use HTTPS with the provided machine user token and name" binary=pipelines version=v0.2.4
time="2023-12-05T01:21:39Z" level=info msg="Starting Pipelines executor..." binary=pipelines version=v0.2.4
time="2023-12-05T01:21:39Z" level=info msg="Checking out branch: 5e2dec8897f7450c1877c997072fe797f0e6c4fe" binary=pipelines version=v0.2.4
HEAD is now at 5e2dec8 Add `.terraform-version` file
time="2023-12-05T01:21:39Z" level=info msg="Current working directory: /home/runner/work/infrastructure-pipelines/infrastructure-pipelines/infrastructure-live" binary=pipelines version=v0.2.4
time="2023-12-05T01:21:39Z" level=info msg="Changed into directory: dev/us-east-2/dev/data-stores/s3/hrg-dev-backup-archives" binary=pipelines version=v0.2.4
time="2023-12-05T01:21:39Z" level=info msg="Executing Terragrunt with args: plan" binary=pipelines version=v0.2.4

Initializing the backend...

Successfully configured the backend "s3"! Terraform will automatically
use this backend unless the backend configuration changes.
Initializing modules...
Downloading git::ssh://[email protected]/gruntwork-io/terraform-aws-security.git?ref=v0.69.0 for s3_bucket_logs...
- s3_bucket_logs in .terraform/modules/s3_bucket_logs/modules/private-s3-bucket
Downloading git::ssh://[email protected]/gruntwork-io/terraform-aws-security.git?ref=v0.69.0 for s3_bucket_primary...
- s3_bucket_primary in .terraform/modules/s3_bucket_primary/modules/private-s3-bucket
Downloading git::ssh://[email protected]/gruntwork-io/terraform-aws-security.git?ref=v0.69.0 for s3_bucket_replica...
- s3_bucket_replica in .terraform/modules/s3_bucket_replica/modules/private-s3-bucket
╷
│ Error: Unsupported Terraform Core version
│ 
│   on provider_version_override.tf line 3, in terraform:
│    3:   required_version = "<= 1.5.5"
│ 
│ This configuration does not support Terraform version 1.6.4. To proceed,
│ either choose another supported Terraform version or update this version
│ constraint. Version constraints are normally set for good reason, so
│ updating the constraint may lead to other errors or unexpected behavior.
╵

Tracked in ticket #110616

Answered by yhakbar

Dec 19, 2023

Hey @jeffreymlewis , thanks for your PR. We've taken a slightly different tactic in this PR:
gruntwork-io/pipelines-execute#9

Do you mind confirming that as of the latest release the action is working in your environment?

Apologies for the delay in resolution.

View full answer

gitsstewart · 2023-12-05T16:55:27Z

gitsstewart
Dec 5, 2023

@jeffreymlewis our new Pipelines product does not yet provide support for Terraform beyond version 1.5.5 due to the changes in Hashicorp licensing.

13 replies

yhakbar Dec 8, 2023
Maintainer

@jeffreymlewis

The most recent release of the action should address the issues that you're experiencing:
https://github.com/gruntwork-io/pipelines-execute/releases/tag/v2.1.0

Please confirm when convenient, and let us know if you have any other issues!

jeffreymlewis Dec 19, 2023
Author

@oredavids @yhakbar Still not working, same issue. Did you folks test this? (I'm curious why this is working for you, but not working for me?)

I'll fix this, and submit a PR for you.

Also FYI, putting a PATH declaration into ~/.bash_profile did not have the desired affect, because the /etc/profile on this system doesn't source ~/.bash_profile. So you should probably either remove that, or fix.

│ Error: Unsupported Terraform Core version
│ 
│   on provider_version_override.tf line 3, in terraform:
│    3:   required_version = "<= 1.5.5"
│ 
│ This configuration does not support Terraform version 1.6.5. To proceed,
│ either choose another supported Terraform version or update this version
│ constraint. Version constraints are normally set for good reason, so
│ updating the constraint may lead to other errors or unexpected behavior.

jeffreymlewis Dec 19, 2023
Author

@oredavids @yhakbar I've created this PR for you. The thing to know, is that environment variables set in a step, are NOT available in subsequent steps. If you want to do this, you need to use GITHUB_ENV or outputs.

gruntwork-io/pipelines-execute#8

The above pipelines-execute is now working for me. Let me know when you've merged a long-term fix, so I can switch back to using the GW repo (rather then my forked repo). Thanks!

yhakbar Dec 19, 2023
Maintainer

Hey @jeffreymlewis , thanks for your PR. We've taken a slightly different tactic in this PR:
gruntwork-io/pipelines-execute#9

Do you mind confirming that as of the latest release the action is working in your environment?

Apologies for the delay in resolution.

Answer selected by jeffreymlewis

jeffreymlewis Jan 3, 2024
Author

It looks like release v2.1.1 in pipelines-execute includes this fix. I'll check it out today.

jeffreymlewis Jan 4, 2024
Author

The new release works as expected. Thanks @yhakbar !

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Gruntwork

Gruntwork Pipelines using wrong terraform version #789

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 13 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Gruntwork

Gruntwork Pipelines using wrong terraform version #789

jeffreymlewis Dec 5, 2023

Replies: 1 comment · 13 replies

gitsstewart Dec 5, 2023

yhakbar Dec 8, 2023 Maintainer

jeffreymlewis Dec 19, 2023 Author

jeffreymlewis Dec 19, 2023 Author

yhakbar Dec 19, 2023 Maintainer

jeffreymlewis Jan 3, 2024 Author

jeffreymlewis Jan 4, 2024 Author

jeffreymlewis
Dec 5, 2023

Replies: 1 comment 13 replies

gitsstewart
Dec 5, 2023

yhakbar Dec 8, 2023
Maintainer

jeffreymlewis Dec 19, 2023
Author

jeffreymlewis Dec 19, 2023
Author

yhakbar Dec 19, 2023
Maintainer

jeffreymlewis Jan 3, 2024
Author

jeffreymlewis Jan 4, 2024
Author