Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create_disk: Add bootupd-epoch, hard require new bootupd #3631

Closed
wants to merge 1 commit into from

Conversation

cgwalters
Copy link
Member

@cgwalters cgwalters commented Sep 20, 2023

src/create_disk.sh Outdated Show resolved Hide resolved
build.sh Outdated Show resolved Hide resolved
src/create_disk.sh Outdated Show resolved Hide resolved
@dustymabe
Copy link
Member

Thanks for working on this

src/create_disk.sh Outdated Show resolved Hide resolved
ravanelli
ravanelli previously approved these changes Sep 20, 2023
Copy link
Member

@ravanelli ravanelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding it @cgwalters!
Overall LGTM, waiting to see #3631 (comment)

@cgwalters cgwalters force-pushed the enable-bootupd-bios branch 2 times, most recently from 2f2fbea to 8a891ae Compare September 20, 2023 22:14
@cgwalters
Copy link
Member Author

Now with a config knob, off by default. This definitely needs some careful review (whee shell script fragility) and testing (across all architectures really).

build.sh Outdated Show resolved Hide resolved
@dustymabe
Copy link
Member

Now with a config knob, off by default. This definitely needs some careful review (whee shell script fragility) and testing (across all architectures really).

+1 - i'll take a closer look in the morning when I'm fresh. Once we get it close on code review we can do a COSA build in the pipeline and run it through the bump-lockfile job in the staging pipeline (tests against all architectures).

src/create_disk.sh Outdated Show resolved Hide resolved
Copy link
Member

@jlebon jlebon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should probably sanity-check the epoch 1 path manually on aarch64 and ppc64le.

src/create_disk.sh Outdated Show resolved Hide resolved
src/create_disk.sh Outdated Show resolved Hide resolved
@cgwalters cgwalters force-pushed the enable-bootupd-bios branch 2 times, most recently from 1405ab9 to ab421a0 Compare September 21, 2023 17:54
@cgwalters cgwalters changed the title create_disk: Use bootupd for BIOS too create_disk: Add bootupd-epoch = 0|1 Sep 21, 2023
@cgwalters
Copy link
Member Author

Tested now on x86_64, booting BIOS and UEFI in both epoch 0 and 1.

@cgwalters
Copy link
Member Author

Note that we're also discussing moving the static grub configs into a subpackage of bootupd, xref coreos/bootupd#536

If we did that, it'd be another epoch. (Which, if we agree to do it, maybe we should just make "epoch 1" be that)

@cgwalters
Copy link
Member Author

Renata added this on internal chat but replicating here: Once we do this we also want to update https://docs.fedoraproject.org/en-US/fedora-coreos/bootloader-updates/

(That said, in the context of Sagano this would actually be a Sagano doc, not a CoreOS doc...)

@jlebon
Copy link
Member

jlebon commented Sep 21, 2023

Interesting, CI just hit coreos/rpm-ostree#4565. So I guess #3619 didn't do the trick.

jlebon
jlebon previously approved these changes Sep 21, 2023
Copy link
Member

@jlebon jlebon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! (Would still be good to do some multi-arch testing but it being opt in means we can easily test it in e.g. rawhide first before propagating.)

Note that we're also discussing moving the static grub configs into a subpackage of bootupd, xref coreos/bootupd#536

I'm not sure that makes sense. Posted in coreos/bootupd#536 (comment).

chroot_run /usr/bin/bootupctl backend install --src-root="${deploy_root}" "${bootupd_args[@]}" "${rootfs}"
case "${arch}" in
x86_64|aarch64)
inject_grub_uefi
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

optional: I think this would be slightly easier to follow if the inject_grub_cfg wasn't embedded in inject_grub_uefi but rather called at the same level:

Suggested change
inject_grub_uefi
inject_grub_uefi
inject_grub_cfg

i.e. it would make it clearer that x86_64 and aarch64 need BOTH inject_grub_uefi and inject_grub_cfg, but ppc64le only needs inject_grub_cfg.

# Unshare mount ns to work around https://github.com/coreos/bootupd/issues/367
unshare -m /usr/bin/bootupctl backend install --src-root="${deploy_root}" "${rootfs}"
inject_grub_uefi
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if we do https://github.com/coreos/coreos-assembler/pull/3631/files#r1334584042 then we'd need to add a call here:

Suggested change
inject_grub_uefi
inject_grub_uefi
inject_grub_cfg

@dustymabe
Copy link
Member

Let me know what you think of the optional comments. Otherwise everything LGTM. I can do a multi-arch build of COSA and run this through the staging bump-lockfile job with both epoch 0 and 1 to see how the architectures respond to it if you like.

@cgwalters
Copy link
Member Author

Sure, SGTM (honestly feel free to force push cleanups here if you like).

That said I think I'd actually want to wait and make "epoch 1" include the grub.cfg rework, so will release a new bootupd soon.

cgwalters added a commit to cgwalters/bootupd that referenced this pull request Sep 29, 2023
As of right now all known callers of this pass `/`.  More generally
we now expect bootupd to run in a container inside its target
root; never outside of it.

xref coreos/coreos-assembler#3631
@cgwalters
Copy link
Member Author

See coreos/bootupd#543 (not totally proud of it, kind of hacky but...) anyways this is now updated to also take ownership of most of the grub config, what's left here is platform.cfg stuff.

I wonder if this PR would be better off actually just fully deleting the old code? Landing now would make it easier to test locally, but only slightly. The patch here would be way less ugly if it was 70% deletions instead.

@cgwalters cgwalters force-pushed the enable-bootupd-bios branch from 2ae4e50 to ae5352a Compare October 12, 2023 17:58
@cgwalters cgwalters changed the title create_disk: Add bootupd-epoch = 0|1 create_disk: Add bootupd-epoch, hard require new bootupd Oct 12, 2023
@cgwalters
Copy link
Member Author

OK this now builds on coreos/bootupd#543 and coreos/ignition#1728
And I've reworked it to just completely delete the old code. We can land this once we've updated bootupd and ignition in fcos (ugh I guess all the way to stable?) and tagged into rhcos.

@cgwalters cgwalters force-pushed the enable-bootupd-bios branch from ae5352a to ed7fce9 Compare October 12, 2023 18:34
@openshift-ci
Copy link

openshift-ci bot commented Oct 12, 2023

@cgwalters: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/rhcos ed7fce9 link true /test rhcos

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@cgwalters
Copy link
Member Author

I guess one option is to basically close this PR and aim to try to cut over to osbuild in #3643 ?

@dustymabe
Copy link
Member

I think this PR is still useful. I wanted to get back to it and run it through some tests on multi-arch in the staging pipeline.

This has also been nice inspiration for @ravanelli who is working on a bootupd stage in osbuild.

@cgwalters
Copy link
Member Author

Right, it was useful to write this to sanity check the bootupd support.

(Incidentally containers/bootc#157 also landed)

@dustymabe
Copy link
Member

going to close this out since we are moving away from using create_disk for our disk image creation.

@dustymabe dustymabe closed this May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants