Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Skip kani if not enough RAM #4136

Merged
merged 2 commits into from
Oct 6, 2023

Conversation

roypat
Copy link
Contributor

@roypat roypat commented Sep 27, 2023

Trying to run the kani integration test outside of the CI will almost certainly result in out of memory conditions in the best case, and in system hangs in the worst case. Therefore, do not attempt to run kani if running tests locally.

Also removes an unneeded assertion, as run_cmd already checks the exit code by default.

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following
Developer Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • If a specific issue led to this PR, this PR closes the issue.
  • The description of changes is clear and encompassing.
  • Any required documentation changes (code and docs) are included in this PR.
  • API changes follow the Runbook for Firecracker API changes.
  • User-facing changes are mentioned in CHANGELOG.md.
  • All added/changed functionality is tested.
  • New TODOs link to an issue.
  • Commits meet contribution quality standards.

  • This functionality cannot be added in rust-vmm.

@codecov
Copy link

codecov bot commented Sep 27, 2023

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (5326773) 83.10% compared to head (b690683) 83.10%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4136   +/-   ##
=======================================
  Coverage   83.10%   83.10%           
=======================================
  Files         225      225           
  Lines       28605    28605           
=======================================
  Hits        23772    23772           
  Misses       4833     4833           
Flag Coverage Δ
4.14-c7g.metal 78.67% <ø> (ø)
4.14-m5d.metal 80.47% <ø> (-0.02%) ⬇️
4.14-m6a.metal 79.61% <ø> (ø)
4.14-m6g.metal 78.67% <ø> (ø)
4.14-m6i.metal 80.45% <ø> (ø)
5.10-c7g.metal 81.57% <ø> (ø)
5.10-m5d.metal 83.13% <ø> (-0.02%) ⬇️
5.10-m6a.metal 82.37% <ø> (ø)
5.10-m6g.metal 81.57% <ø> (ø)
5.10-m6i.metal 83.11% <ø> (ø)
6.1-c7g.metal 81.57% <ø> (ø)
6.1-m5d.metal 83.13% <ø> (-0.02%) ⬇️
6.1-m6a.metal 82.37% <ø> (ø)
6.1-m6g.metal 81.57% <ø> (ø)
6.1-m6i.metal 83.11% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@roypat roypat marked this pull request as ready for review September 27, 2023 11:17
@roypat roypat changed the title test: Skip kani if not in CI test: Skip kani if not enough RAM Sep 27, 2023
@roypat roypat added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Sep 27, 2023
tests/integration_tests/test_kani.py Outdated Show resolved Hide resolved
@roypat roypat force-pushed the no-local-kani branch 2 times, most recently from b58cbbd to af498db Compare September 27, 2023 14:31
roypat added 2 commits October 6, 2023 10:11
Trying to run the kani integration test outside of the CI will almost
certainly result in out of memory conditions in the best case, and in
system hangs in the worst case. Therefore, do not attempt to run kani if
running tests locally.

Signed-off-by: Patrick Roy <[email protected]>
Currently, we only run kani if a .rs file is modified. We should also
run it if dependencies are changed.

Signed-off-by: Patrick Roy <[email protected]>
Copy link
Contributor

@bchalios bchalios left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, mainly questions for my education

docs/formal-verification.md Show resolved Hide resolved
tests/integration_tests/test_kani.py Show resolved Hide resolved
@bchalios bchalios merged commit 2bc525b into firecracker-microvm:main Oct 6, 2023
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Awaiting review Indicates that a pull request is ready to be reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants