Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: make explist e2e sort test more reliable #10067

Merged
merged 4 commits into from
Oct 29, 2024

Conversation

ashtonG
Copy link
Contributor

@ashtonG ashtonG commented Oct 16, 2024

Ticket

ET-828

Description

this updates the experiment list e2e multi sort test:

  1. the test could flake if the table was comparing numeric values lower than 10 with numeric values larger than 10.

  2. the test helper now handles both the setup and scenario steps, allowing for more levels of sorting.

the multi sort menu is also updated to output the values of the direction selector to the dom to allow selections during the e2e tests that don't need to be aware of the column copy.

Test Plan

react e2e tests should pass. will run back-to-back test suites on circleci to validate non-flakiness.

Checklist

  • Changes have been manually QA'd
  • New features have been approved by the corresponding PM
  • User-facing API changes have the "User-facing API Change" label
  • Release notes have been added as a separate file under docs/release-notes/
    See Release Note for details.
  • Licenses have been included for new code which was copied and/or modified from any external code

this updates the experiment list e2e multi sort test:

1) the test could flake if the table was comparing numeric values lower
than 10 with numeric values larger than 10.

2) the test helper now handles both the setup and scenario steps,
allowing for more levels of sorting.

the multi sort menu is also updated to output the values of the
direction selector to the dom to allow selections during the e2e tests
that don't need to be aware of the column copy.
@ashtonG ashtonG requested review from a team as code owners October 16, 2024 18:55
@cla-bot cla-bot bot added the cla-signed label Oct 16, 2024
Copy link

netlify bot commented Oct 16, 2024

Deploy Preview for determined-ui ready!

Name Link
🔨 Latest commit 88bf173
🔍 Latest deploy log https://app.netlify.com/sites/determined-ui/deploys/6712d1b089cc2b0008c6c87b
😎 Deploy Preview https://deploy-preview-10067--determined-ui.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

codecov bot commented Oct 16, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 50.38%. Comparing base (9efd96d) to head (88bf173).
Report is 74 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #10067      +/-   ##
==========================================
- Coverage   54.41%   50.38%   -4.03%     
==========================================
  Files        1262      952     -310     
  Lines      158886   130251   -28635     
  Branches     3632     3632              
==========================================
- Hits        86454    65625   -20829     
+ Misses      72298    64492    -7806     
  Partials      134      134              
Flag Coverage Δ
harness ?
web 53.96% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
webui/react/src/components/MultiSortMenu.tsx 88.81% <100.00%> (+0.26%) ⬆️

... and 310 files with indirect coverage changes

await multiSortMenu.open();
await multiSortMenu.multiSort.reset.pwLocator.click();
// weirdness alert: reset closes the sort menu normally, but doesn't
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for the comment

await checkTableOrder('Trial count', 'Searcher Metric', true);
});
});
testSorts([
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

very clean!

@ashtonG ashtonG merged commit 66d7ff1 into main Oct 29, 2024
84 of 97 checks passed
@ashtonG ashtonG deleted the test/ET-828/experiment-list-sort-deflake branch October 29, 2024 17:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants