Skip to content

Commit

Permalink
Benchmarking tests: automatically restore Neon reuse databases, too a…
Browse files Browse the repository at this point in the history
…nd migrate to pg16 (#8707)

## Problem

We use a set of **Neon** reuse databases in benchmarking.yml which are
still using pg14.
Because we want to compare apples to apples and have migrated the AWS
reuse clusters to pg16 we should also use pg16 for Neon.

## Summary of changes

- Automatically restore the test databases for Neon project
  • Loading branch information
Bodobolero authored Aug 13, 2024
1 parent ae6e272 commit 9d22763
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion .github/workflows/_benchmarking_preparation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:
strategy:
fail-fast: false
matrix:
platform: [ aws-rds-postgres, aws-aurora-serverless-v2-postgres ]
platform: [ aws-rds-postgres, aws-aurora-serverless-v2-postgres, neon ]
database: [ clickbench, tpch, userexample ]

env:
Expand All @@ -31,6 +31,9 @@ jobs:
id: set-up-prep-connstr
run: |
case "${PLATFORM}" in
neon)
CONNSTR=${{ secrets.BENCHMARK_CAPTEST_CONNSTR }}
;;
aws-rds-postgres)
CONNSTR=${{ secrets.BENCHMARK_RDS_POSTGRES_CONNSTR }}
;;
Expand Down

1 comment on commit 9d22763

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2204 tests run: 2124 passed, 1 failed, 79 skipped (full report)


Failures on Postgres 14

  • test_heavy_write_workload[neon_off-github-actions-selfhosted-10-5-5]: release
# Run all failed tests locally:
scripts/pytest -vv -n $(nproc) -k "test_heavy_write_workload[neon_off-release-pg14-github-actions-selfhosted-10-5-5]"
Flaky tests (1)

Postgres 16

  • test_layer_bloating: debug

Code coverage* (full report)

  • functions: 32.4% (7165 of 22122 functions)
  • lines: 50.4% (57924 of 114945 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
9d22763 at 2024-08-13T19:52:05.852Z :recycle:

Please sign in to comment.