Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GCC 12 CUDA 12 build pipeline in CSCS CI #858

Merged
merged 4 commits into from
Dec 8, 2023
Merged

Add GCC 12 CUDA 12 build pipeline in CSCS CI #858

merged 4 commits into from
Dec 8, 2023

Conversation

aurianer
Copy link
Contributor

@aurianer aurianer commented Nov 15, 2023 •
edited
Loading

Part of #32.

@aurianer aurianer added the category: CI Continuous Integration label Nov 15, 2023
@aurianer aurianer added this to the 0.21.0 milestone Nov 15, 2023
@aurianer aurianer self-assigned this Nov 15, 2023
@aurianer
Copy link
Contributor Author

cscs-ci run

@msimberg
Copy link
Contributor

Given that hohgant is likely to be shut down soon, and clariden is going to stay around at least for a while, perhaps it's worth using clariden right away for this (and #846).

@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 8a1384e to 6146d2f Compare November 18, 2023 19:39
@aurianer
Copy link
Contributor Author

cscs-ci run

@pika-bot
Copy link
Collaborator

Performance test report

pika Performance

Comparison

BENCHMARKNO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch-

Info

PropertyBeforeAfter
pika Datetime2023-08-21T11:44:55+00:002023-11-18T19:39:13+00:00
pika Commit02f9de8e709397
Datetime2023-08-21T13:50:51.685166+02:002023-11-18T20:44:57.277355+01:00
Compiler/apps/daint/SSL/pika/spack/lib/spack/env/clang/clang++ 11.0.1/apps/daint/SSL/pika/spack/lib/spack/env/clang/clang++ 11.0.1
Hostnamenid01181nid01181
Envfile
Clusternamedaintdaint

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (>10%)
++/--Large performance improvement/degradation (>10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 6146d2f to c11b206 Compare November 19, 2023 20:39
@aurianer aurianer changed the title Add gcc 12 cuda 12 pipeline on hohgant in CSCS CI Add gcc 12 cuda 12 pipeline on clariden in CSCS CI Nov 20, 2023
@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from c11b206 to 9983939 Compare November 20, 2023 10:53
@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 9983939 to d0c6c2b Compare December 1, 2023 12:13
@msimberg
Copy link
Contributor

msimberg commented Dec 4, 2023

cscs-ci run

@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from d0c6c2b to b98fe3c Compare December 4, 2023 16:16
@aurianer
Copy link
Contributor Author

aurianer commented Dec 4, 2023

cscs-ci run

@msimberg msimberg removed this from the 0.21.0 milestone Dec 5, 2023
@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from b98fe3c to 872b2b7 Compare December 5, 2023 18:20
@aurianer
Copy link
Contributor Author

aurianer commented Dec 5, 2023

cscs-ci run

@aurianer
Copy link
Contributor Author

aurianer commented Dec 5, 2023

So this was blocked because the pika project is not yet added for clariden. They limit how many CI is running on the cluster since it's supposed to be dedicated to ML. It will be temporarily allowed for pika and similar projects since there is no other system with the same GPU setup yet. But we'll have to move away from clariden in a short while :)

@msimberg
Copy link
Contributor

msimberg commented Dec 6, 2023

I think the older driver version on clariden is still a blocker for https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/479009878135925/5304355110917878/-/jobs/5687359105#L519. Please disable testing for now so that we can get builds merged, open an issue, and let's revisit this before the end of the next release cycle.

@msimberg msimberg changed the title Add gcc 12 cuda 12 pipeline on clariden in CSCS CI Add GCC 12 CUDA 12 pipeline on clariden in CSCS CI Dec 6, 2023
@msimberg msimberg changed the title Add GCC 12 CUDA 12 pipeline on clariden in CSCS CI Add GCC 12 CUDA 12 build pipeline in CSCS CI Dec 6, 2023
@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 872b2b7 to aebe264 Compare December 6, 2023 11:00
@pika-bot
Copy link
Collaborator

pika-bot commented Dec 6, 2023

Performance test report

pika Performance

Comparison

BENCHMARKNO-EXECUTOR
Task Overhead - Create Thread Hierarchical - Latch-

Info

PropertyBeforeAfter
pika Commit02f9de8bcec0fc
pika Datetime2023-08-21T11:44:55+00:002023-12-06T11:00:47+00:00
Clusternamedaintdaint
Compiler/apps/daint/SSL/pika/spack/lib/spack/env/clang/clang++ 11.0.1/apps/daint/SSL/pika/spack/lib/spack/env/clang/clang++ 11.0.1
Datetime2023-08-21T13:50:51.685166+02:002023-12-06T12:10:31.139707+01:00
Envfile
Hostnamenid01181nid01616

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (>10%)
++/--Large performance improvement/degradation (>10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

@aurianer aurianer marked this pull request as ready for review December 6, 2023 11:22
@aurianer
Copy link
Contributor Author

aurianer commented Dec 6, 2023

cscs-ci run

@aurianer
Copy link
Contributor Author

aurianer commented Dec 6, 2023

Opened this: #884

@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 02c5678 to 504b63d Compare December 7, 2023 13:13
@aurianer aurianer force-pushed the add_gcc12_cuda12_pipeline_cscsci branch from 504b63d to 134cbdb Compare December 7, 2023 13:14
@aurianer
Copy link
Contributor Author

aurianer commented Dec 7, 2023

cscs-ci run

@msimberg msimberg added this pull request to the merge queue Dec 8, 2023
Merged via the queue into pika-org:main with commit 8b5b2b4 Dec 8, 2023
67 checks passed
@msimberg msimberg added this to the 0.22.0 milestone Jan 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@msimberg msimberg msimberg approved these changes

@biddisco biddisco Awaiting requested review from biddisco biddisco is a code owner

Assignees

@aurianer aurianer

Labels
category: CI Continuous Integration
Projects
pika planning board
Status: Archive
Milestone
0.22.0
Development

Successfully merging this pull request may close these issues.
3 participants
@aurianer @msimberg @pika-bot