Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nothing to see here, just for testing CI #53

Merged
merged 1 commit into from
Dec 2, 2024
Merged

Nothing to see here, just for testing CI #53

merged 1 commit into from
Dec 2, 2024

Conversation

fhilgers
Copy link
Collaborator

@fhilgers fhilgers commented Nov 6, 2024

No description provided.

@fhilgers fhilgers changed the title WIP Nothing to see here, just for testing CI Nov 6, 2024
@fhilgers fhilgers force-pushed the ci-experiments branch 29 times, most recently from b91c599 to 4cea332 Compare November 6, 2024 20:17
@fhilgers fhilgers force-pushed the ci-experiments branch 5 times, most recently from a25a695 to e942c20 Compare November 8, 2024 00:44
@BenediktZinn
Copy link
Contributor

can this be closed?

@fhilgers
Copy link
Collaborator Author

No, I have to adapt it for the changes then merge it.

@fhilgers fhilgers force-pushed the ci-experiments branch 3 times, most recently from ac99f07 to ec0519f Compare December 2, 2024 22:44
@luca-dot-sh luca-dot-sh self-requested a review December 2, 2024 22:51
This change speeds up our current CI pipeline by a lot (20min -> 2min).

We are using a self hosted S3 cache on hetzner and a single large
server, also hosted on S3.

The main reason our old CI system was slow is that we have a large
amount of toolchains that are not installed by default on the github
runners. That means that every job in the CI has to download about 10Gb
of data, just for the toolchains.

The new system is way faster, we have a single server with nix
installed. On this server there are multiple github runners. Each of
them share a single nix store. They also share the gradle caches in the
home directory.

The build artifacts are cached to S3 which is both local and cheap.

Signed-off-by: Felix Hilgers <[email protected]>
@fhilgers fhilgers marked this pull request as ready for review December 2, 2024 22:56
@fhilgers fhilgers merged commit e8cb14b into dev Dec 2, 2024
7 checks passed
@fhilgers fhilgers deleted the ci-experiments branch December 2, 2024 22:59
@fhilgers fhilgers mentioned this pull request Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants