Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2024-11-27 | MAIN --> PROD | DEV (4c35b8e) --> STAGING #4490

Merged
merged 5 commits into from
Nov 27, 2024
Merged

2024-11-27 | MAIN --> PROD | DEV (4c35b8e) --> STAGING #4490

merged 5 commits into from
Nov 27, 2024

Conversation

jadudm
Copy link
Contributor

@jadudm jadudm commented Nov 27, 2024

This is an auto-generated pull request to merge main into prod for a staging release on 2024-11-27 with the last commit being merged as 4c35b8e

phildominguez-gsa and others added 5 commits November 26, 2024 14:13
* Adding check_finding_prior_references and tests

* Cleanup

* Adding test_get_prior_refs_no_repeat_prior_reference

* Removing unused fields

* Changing EIN for UEI

* Replacing audit_year with auditee_fiscal_period_start and fixing error format

* Checking for prior refs earlier

* Ignoring prior refs before 2022

* Checking for reports from prior ref's year

* Tests can now generate prior reports from priof ref numbers

* Reducing complexity; adding comments

* Supporting validation waiver

* Adding admin prior ref waiver creation case

* Lint

* Querying all previous reports for prior refs

* Lint

* Removing report_id exclusion

* Updating cypress tests to use 2023 submission

* Skipping validation for old prior refs

* Numeric string check

* Fixing test wb

* Removing redundant N/A check

* Reworking error message

* Error message tweak
* Validate redirect URLs

* django-test fix
* Modification to queries

* Modify dashboard

* Account for db_to_db backup logs
* Bumping dependencies

* Lint
@jadudm jadudm added autogenerated Automated pull request creation automerge Used for automated deployments labels Nov 27, 2024
Copy link
Contributor

github-actions bot commented Nov 27, 2024

Terraform plan for staging

Plan: 1 to add, 3 to change, 1 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place
-/+ destroy and then create replacement

Terraform will perform the following actions:

  # module.staging.module.clamav.cloudfoundry_app.clamav_api will be updated in-place
!~  resource "cloudfoundry_app" "clamav_api" {
!~      docker_image                    = "ghcr.io/gsa-tts/fac/clamav@sha256:08c3e58e94966e799627891bdcc5ca46843955d11032f9adfea7e4623656881c" -> "ghcr.io/gsa-tts/fac/clamav@sha256:0188c58cf771da2914275f870a05aeb45b4b25d8a9e71be06cd854da719c8ed5"
        id                              = "d1bea029-d2d3-4b68-b16d-b216bcaea573"
        name                            = "fac-av-staging"
#        (17 unchanged attributes hidden)

#        (1 unchanged block hidden)
    }

  # module.staging.module.cors.null_resource.cors_header must be replaced
-/+ resource "null_resource" "cors_header" {
!~      id       = "*******************" -> (known after apply)
!~      triggers = { # forces replacement
!~          "always_run" = "2024-11-23T10:57:08Z" -> (known after apply)
        }
    }

  # module.staging.module.file_scanner_clamav.cloudfoundry_app.clamav_api will be updated in-place
!~  resource "cloudfoundry_app" "clamav_api" {
!~      docker_image                    = "ghcr.io/gsa-tts/fac/clamav@sha256:08c3e58e94966e799627891bdcc5ca46843955d11032f9adfea7e4623656881c" -> "ghcr.io/gsa-tts/fac/clamav@sha256:0188c58cf771da2914275f870a05aeb45b4b25d8a9e71be06cd854da719c8ed5"
        id                              = "e416bb0c-8b95-47f7-9cff-c4029ebbd2df"
        name                            = "fac-av-staging-fs"
#        (17 unchanged attributes hidden)

#        (1 unchanged block hidden)
    }

  # module.staging.module.newrelic.newrelic_one_dashboard.log_review_dashboard will be updated in-place
!~  resource "newrelic_one_dashboard" "log_review_dashboard" {
        id          = "MzkxOTA3NnxWSVp8REFTSEJPQVJEfGRhOjYzNjI3NDM"
        name        = "FAC Log Review (staging)"
#        (4 unchanged attributes hidden)

!~      page {
            name        = "FAC Log Review"
#            (2 unchanged attributes hidden)

+           widget_log_table {
+               column         = 1
+               height         = 3
+               legend_enabled = true
+               row            = 10
+               title          = "staging Submissions within the past 2 hours"
+               width          = 8

+               nrql_query {
+                   query = "SELECT `message` FROM Log WHERE allColumnSearch('POST', insensitive: true) AND allColumnSearch('/submission/', insensitive: true) AND `newrelic.source` = 'logs.APM' AND `entity.name` = 'gsa-fac-staging' SINCE 2 hours ago"
                }
            }
+           widget_log_table {
+               column         = 9
+               height         = 3
+               legend_enabled = true
+               row            = 10
+               title          = "staging Backups within the past 2 hours"
+               width          = 3

+               nrql_query {
+                   query = "SELECT `timestamp`,`message` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' OR `message` LIKE '%db_to_db%' AND `message` LIKE '%PASS%' AND `tags.space_name` = 'staging' SINCE 2 hours ago"
                }
            }
+           widget_log_table {
+               column         = 1
+               height         = 3
+               legend_enabled = true
+               row            = 11
+               title          = "staging Row Count within the past 2 hours"
+               width          = 8

+               nrql_query {
+                   query = "SELECT `message` FROM Log WHERE `tags.space_name` = 'staging' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 2 hours ago"
                }
            }

!~          widget_table {
                id                       = "298942399"
!~              row                      = 10 -> 12
!~              title                    = "staging Backups and Submissions" -> "staging Row Count"
#                (11 unchanged attributes hidden)

!~              nrql_query {
!~                  query      = "SELECT `message` FROM Log WHERE allColumnSearch('POST', insensitive: true) AND allColumnSearch('/submission/', insensitive: true) AND `newrelic.source` = 'logs.APM' AND entity.name ='staging' SINCE 2 hours ago" -> "SELECT `message` FROM Log WHERE `tags.space_name` = 'staging' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 7 days ago"
#                    (1 unchanged attribute hidden)
                }
-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message`,`timestamp` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' AND `message` LIKE '%PASS%' AND tags.space_name ='staging' SINCE 2 hours ago" -> null
                }
            }
-           widget_table {
-               column                   = 1 -> null
-               facet_show_other_series  = false -> null
-               filter_current_dashboard = false -> null
-               height                   = 3 -> null
-               id                       = "298942400" -> null
-               ignore_time_range        = false -> null
-               legend_enabled           = true -> null
-               linked_entity_guids      = [] -> null
-               row                      = 11 -> null
-               title                    = "staging Backup and Row Count" -> null
-               width                    = 8 -> null
-               y_axis_left_max          = 0 -> null
-               y_axis_left_min          = 0 -> null
#                (1 unchanged attribute hidden)

-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message` FROM Log WHERE `tags.space_name` = 'staging' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 2 hours ago" -> null
                }
-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message`,`timestamp` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' AND `message` LIKE '%PASS%' AND tags.space_name ='staging' SINCE 2 hours ago" -> null
                }
            }
-           widget_table {
-               column                   = 1 -> null
-               facet_show_other_series  = false -> null
-               filter_current_dashboard = false -> null
-               height                   = 3 -> null
-               id                       = "298942401" -> null
-               ignore_time_range        = false -> null
-               legend_enabled           = true -> null
-               linked_entity_guids      = [] -> null
-               row                      = 12 -> null
-               title                    = "staging Row Count" -> null
-               width                    = 8 -> null
-               y_axis_left_max          = 0 -> null
-               y_axis_left_min          = 0 -> null
#                (1 unchanged attribute hidden)

-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message` FROM Log WHERE `tags.space_name` = 'staging' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 7 days ago" -> null
                }
            }

#            (17 unchanged blocks hidden)
        }
    }

Plan: 1 to add, 3 to change, 1 to destroy.

✅ Plan applied in Deploy to Staging Environment #294

Copy link
Contributor

github-actions bot commented Nov 27, 2024

Terraform plan for production

Plan: 1 to add, 3 to change, 1 to destroy.
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place
-/+ destroy and then create replacement

Terraform will perform the following actions:

  # module.production.module.clamav.cloudfoundry_app.clamav_api will be updated in-place
!~  resource "cloudfoundry_app" "clamav_api" {
!~      docker_image                    = "ghcr.io/gsa-tts/fac/clamav@sha256:8bbaddd65b051d4ba2df629392d98d98e019602e6579b5af3ed905b34bd94140" -> "ghcr.io/gsa-tts/fac/clamav@sha256:0188c58cf771da2914275f870a05aeb45b4b25d8a9e71be06cd854da719c8ed5"
        id                              = "5d0afa4f-527b-472a-8671-79a60335417f"
        name                            = "fac-av-production"
#        (17 unchanged attributes hidden)

#        (1 unchanged block hidden)
    }

  # module.production.module.cors.null_resource.cors_header must be replaced
-/+ resource "null_resource" "cors_header" {
!~      id       = "*******************" -> (known after apply)
!~      triggers = { # forces replacement
!~          "always_run" = "2024-11-20T18:59:00Z" -> (known after apply)
        }
    }

  # module.production.module.file_scanner_clamav.cloudfoundry_app.clamav_api will be updated in-place
!~  resource "cloudfoundry_app" "clamav_api" {
!~      docker_image                    = "ghcr.io/gsa-tts/fac/clamav@sha256:8bbaddd65b051d4ba2df629392d98d98e019602e6579b5af3ed905b34bd94140" -> "ghcr.io/gsa-tts/fac/clamav@sha256:0188c58cf771da2914275f870a05aeb45b4b25d8a9e71be06cd854da719c8ed5"
        id                              = "6b0ce685-a80c-4feb-9ed6-49c6427efdb8"
        name                            = "fac-av-production-fs"
#        (17 unchanged attributes hidden)

#        (1 unchanged block hidden)
    }

  # module.production.module.newrelic.newrelic_one_dashboard.log_review_dashboard will be updated in-place
!~  resource "newrelic_one_dashboard" "log_review_dashboard" {
        id          = "MzkxOTA3NnxWSVp8REFTSEJPQVJEfGRhOjY0MzQ5OTY"
        name        = "FAC Log Review (production)"
#        (4 unchanged attributes hidden)

!~      page {
            name        = "FAC Log Review"
#            (2 unchanged attributes hidden)

+           widget_log_table {
+               column         = 1
+               height         = 3
+               legend_enabled = true
+               row            = 10
+               title          = "production Submissions within the past 2 hours"
+               width          = 8

+               nrql_query {
+                   query = "SELECT `message` FROM Log WHERE allColumnSearch('POST', insensitive: true) AND allColumnSearch('/submission/', insensitive: true) AND `newrelic.source` = 'logs.APM' AND `entity.name` = 'gsa-fac-production' SINCE 2 hours ago"
                }
            }
+           widget_log_table {
+               column         = 9
+               height         = 3
+               legend_enabled = true
+               row            = 10
+               title          = "production Backups within the past 2 hours"
+               width          = 3

+               nrql_query {
+                   query = "SELECT `timestamp`,`message` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' OR `message` LIKE '%db_to_db%' AND `message` LIKE '%PASS%' AND `tags.space_name` = 'production' SINCE 2 hours ago"
                }
            }
+           widget_log_table {
+               column         = 1
+               height         = 3
+               legend_enabled = true
+               row            = 11
+               title          = "production Row Count within the past 2 hours"
+               width          = 8

+               nrql_query {
+                   query = "SELECT `message` FROM Log WHERE `tags.space_name` = 'production' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 2 hours ago"
                }
            }

!~          widget_table {
                id                       = "298953902"
!~              row                      = 10 -> 12
!~              title                    = "production Backups and Submissions" -> "production Row Count"
#                (11 unchanged attributes hidden)

!~              nrql_query {
!~                  query      = "SELECT `message` FROM Log WHERE allColumnSearch('POST', insensitive: true) AND allColumnSearch('/submission/', insensitive: true) AND `newrelic.source` = 'logs.APM' AND entity.name ='production' SINCE 2 hours ago" -> "SELECT `message` FROM Log WHERE `tags.space_name` = 'production' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 7 days ago"
#                    (1 unchanged attribute hidden)
                }
-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message`,`timestamp` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' AND `message` LIKE '%PASS%' AND tags.space_name ='production' SINCE 2 hours ago" -> null
                }
            }
-           widget_table {
-               column                   = 1 -> null
-               facet_show_other_series  = false -> null
-               filter_current_dashboard = false -> null
-               height                   = 3 -> null
-               id                       = "298953903" -> null
-               ignore_time_range        = false -> null
-               legend_enabled           = true -> null
-               linked_entity_guids      = [] -> null
-               row                      = 11 -> null
-               title                    = "production Backup and Row Count" -> null
-               width                    = 8 -> null
-               y_axis_left_max          = 0 -> null
-               y_axis_left_min          = 0 -> null
#                (1 unchanged attribute hidden)

-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message` FROM Log WHERE `tags.space_name` = 'production' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 2 hours ago" -> null
                }
-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message`,`timestamp` FROM Log WHERE allColumnSearch('STARTUP_CHECK', insensitive: true) AND `message` LIKE '%db_to_s3%' AND `message` LIKE '%PASS%' AND tags.space_name ='production' SINCE 2 hours ago" -> null
                }
            }
-           widget_table {
-               column                   = 1 -> null
-               facet_show_other_series  = false -> null
-               filter_current_dashboard = false -> null
-               height                   = 3 -> null
-               id                       = "298953904" -> null
-               ignore_time_range        = false -> null
-               legend_enabled           = true -> null
-               linked_entity_guids      = [] -> null
-               row                      = 12 -> null
-               title                    = "production Row Count" -> null
-               width                    = 8 -> null
-               y_axis_left_max          = 0 -> null
-               y_axis_left_min          = 0 -> null
#                (1 unchanged attribute hidden)

-               nrql_query {
-                   account_id = 3919076 -> null
-                   query      = "SELECT `message` FROM Log WHERE `tags.space_name` = 'production' AND allColumnSearch('\"TABLEROWCOUNT\"', insensitive: true) SINCE 7 days ago" -> null
                }
            }

#            (17 unchanged blocks hidden)
        }
    }

Plan: 1 to add, 3 to change, 1 to destroy.

✅ Plan applied in Deploy to Production Environment #111

Copy link
Contributor

Code Coverage

Package Line Rate Branch Rate Health
. 100% 100%
api 98% 90%
audit 97% 87%
audit.cross_validation 98% 88%
audit.fixtures 84% 50%
audit.intakelib 90% 81%
audit.intakelib.checks 92% 85%
audit.intakelib.common 98% 82%
audit.intakelib.transforms 100% 94%
audit.management.commands 78% 17%
audit.migrations 100% 100%
audit.models 93% 75%
audit.templatetags 100% 100%
audit.views 60% 39%
census_historical_migration 96% 65%
census_historical_migration.migrations 100% 100%
census_historical_migration.sac_general_lib 92% 84%
census_historical_migration.transforms 95% 90%
census_historical_migration.workbooklib 68% 69%
config 76% 31%
curation 100% 100%
curation.curationlib 57% 100%
curation.migrations 100% 100%
dissemination 91% 72%
dissemination.migrations 97% 25%
dissemination.searchlib 74% 64%
dissemination.templatetags 100% 100%
djangooidc 53% 38%
djangooidc.tests 100% 94%
report_submission 93% 88%
report_submission.migrations 100% 100%
report_submission.templatetags 74% 100%
support 95% 78%
support.management.commands 96% 100%
support.migrations 100% 100%
support.models 97% 83%
tools 98% 50%
users 98% 100%
users.fixtures 100% 83%
users.management 100% 100%
users.management.commands 100% 100%
users.migrations 100% 100%
Summary 91% (17262 / 19052) 77% (2154 / 2812)

Minimum allowed line rate is 85%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autogenerated Automated pull request creation automerge Used for automated deployments
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants