Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE] Forklift caching test #1783

Closed
wants to merge 23 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
c44c327
add forklift for test abd build, use image with rust 1.71
AndWeHaveAPlan Oct 3, 2023
66650a4
rustc_wrapper mode
AndWeHaveAPlan Oct 21, 2023
50ed586
CI_IMAGE
AndWeHaveAPlan Oct 21, 2023
47c7e52
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 6, 2023
1e5d00d
forklift 0.6.9 + cargo alias
AndWeHaveAPlan Nov 9, 2023
da9adc1
forklift PATH
AndWeHaveAPlan Nov 9, 2023
e574b48
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 9, 2023
7283aef
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 10, 2023
960289f
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 13, 2023
ddbd679
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 14, 2023
e9c87b1
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 14, 2023
68928b2
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 16, 2023
07127de
rename rusty-cachier job to forklift
AndWeHaveAPlan Nov 16, 2023
ae9b6d4
forklift clean
AndWeHaveAPlan Nov 18, 2023
d8939f3
rm socket
AndWeHaveAPlan Nov 19, 2023
438dc59
rm -f forklift.sock
AndWeHaveAPlan Nov 19, 2023
9618a4c
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 19, 2023
630c4b7
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 19, 2023
46eb0e1
FORKLIFT_BYPASS
AndWeHaveAPlan Nov 19, 2023
419b1b6
multiline if
AndWeHaveAPlan Nov 19, 2023
4498bc6
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 20, 2023
3fd52ea
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 21, 2023
052f106
Merge branch 'master' into es/forklift-test
AndWeHaveAPlan Nov 21, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 21 additions & 13 deletions .gitlab-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -111,23 +111,31 @@ default:
- !reference [.common-before-script, before_script]
- !reference [.prepare-env, before_script]
- !reference [.rust-info-script, script]
- !reference [.rusty-cachier, before_script]
- !reference [.forklift, before_script]
tags:
- linux-docker

# rusty-cachier's hidden job. Parts of this job are used to instrument the pipeline's other real jobs with rusty-cachier
# rusty-cachier's commands are described here: https://gitlab.parity.io/parity/infrastructure/ci_cd/rusty-cachier/client#description
.rusty-cachier:
#
.forklift:
before_script:
# - curl -s https://gitlab-ci-token:${CI_JOB_TOKEN}@gitlab.parity.io/parity/infrastructure/ci_cd/rusty-cachier/client/-/raw/release/util/install.sh | bash
# - mkdir -p cargo_home cargo_target_dir
# - export CARGO_HOME=$CI_PROJECT_DIR/cargo_home
# - export CARGO_TARGET_DIR=$CI_PROJECT_DIR/cargo_target_dir
# - find . \( -path ./cargo_target_dir -o -path ./cargo_home \) -prune -o -type f -exec touch -t 202005260100 {} +
# - git restore-mtime
# - rusty-cachier --version
# - rusty-cachier project touch-changed
- echo tbd
- 'curl --header "PRIVATE-TOKEN: $FL_CI_GROUP_TOKEN" -o forklift -L "${CI_API_V4_URL}/projects/676/packages/generic/forklift/${FL_FORKLIFT_VERSION}/forklift_${FL_FORKLIFT_VERSION}_linux_amd64"'
- chmod +x forklift
- mkdir .forklift
- cp $FL_FORKLIFT_CONFIG .forklift/config.toml
- export FORKLIFT_PACKAGE_SUFFIX=${CI_JOB_NAME/ [0-9 \/]*}
- shopt -s expand_aliases
- export PATH=$PATH:$(pwd)
- |
if [ "$FORKLIFT_BYPASS" != "true" ]; then
echo "FORKLIFT_BYPASS not set, creating alias cargo='forklift cargo'"
alias cargo="forklift cargo"
fi
- ls -al
- rm -f forklift.sock
- forklift clean
#
- echo "FL_FORKLIFT_VERSION ${FL_FORKLIFT_VERSION}"
- echo "FORKLIFT_PACKAGE_SUFFIX $FORKLIFT_PACKAGE_SUFFIX"

.common-refs:
rules:
Expand Down
1 change: 1 addition & 0 deletions .gitlab/pipeline/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ build-linux-stable:
RUN_UI_TESTS: 1
script:
- time cargo build --locked --profile testnet --features pyroscope,fast-runtime --bin polkadot --bin polkadot-prepare-worker --bin polkadot-execute-worker
#
- time ROCOCO_EPOCH_DURATION=10 ./polkadot/scripts/build-only-wasm.sh rococo-runtime $(pwd)/runtimes/rococo-runtime-10/
- time ROCOCO_EPOCH_DURATION=100 ./polkadot/scripts/build-only-wasm.sh rococo-runtime $(pwd)/runtimes/rococo-runtime-100/
- time ROCOCO_EPOCH_DURATION=600 ./polkadot/scripts/build-only-wasm.sh rococo-runtime $(pwd)/runtimes/rococo-runtime-600/
Expand Down
2 changes: 2 additions & 0 deletions .gitlab/pipeline/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ test-linux-stable:
--no-fail-fast \
--features try-runtime,experimental \
--partition count:${CI_NODE_INDEX}/${CI_NODE_TOTAL}
#
# Upload tests results to Elasticsearch
- echo "Upload test results to Elasticsearch"
- cat target/nextest/default/junit.xml | xq . > target/nextest/default/junit.json
Expand All @@ -40,6 +41,7 @@ test-linux-stable:
https://elasticsearch.parity-build.parity.io/unit-tests/_doc/${CI_JOB_ID} \
-H 'Content-Type: application/json' \
-d @target/nextest/default/junit.json || echo "failed to upload junit report"
#
# run runtime-api tests with `enable-staging-api` feature on the 1st node
- if [ ${CI_NODE_INDEX} == 1 ]; then time cargo nextest run -p sp-api-test --features enable-staging-api; fi
artifacts:
Expand Down
Loading