Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump QMC to 0.3 and fix tests #446

Merged
merged 18 commits into from
Dec 13, 2023
Merged

Conversation

ashutosh-b-b
Copy link
Contributor

No description provided.

Comment on lines 98 to 99
@test_broken (rbf_rmse > moe_rmse)
@test_broken (krig_rmse > moe_rmse)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how come these broke?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure on that. There has been no change in either Kriging or RadialBasis or SurrogatesMOE

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what do the RMSE's look like?

Copy link
Contributor Author

@ashutosh-b-b ashutosh-b-b Nov 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

┌ Info: rbf 
└   rbf_rmse = 0.15820029403909985
┌ Info: krig_rmse
└   krig_rmse = 0.5506133269171736
┌ Info: moe_rmse 
└   moe_rmse = 3.1404026819527395

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What was it before?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[ Info: Initializing GMM, 2 Gaussians diag covariance 3 dimensions using 120 data points
K-means converged with 2 iterations (objv = 84.11037552263687)
┌ Info: K-means with 120 data points using 2 iterations
└ 15.0 data points per parameter
┌ Info: rbf 
└   rbf_rmse = 0.06176607586612947
┌ Info: krig_rmse
└   krig_rmse = 0.23790775421661017
┌ Info: moe_rmse 
└   moe_rmse = 0.011154092911771194

Something definitely broke

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image
It does diverge (this from the current changes).
The older one was line over line
image

@ChrisRackauckas
Copy link
Member

Instead of reviving SectionSampler, can we do the suggest fix of SciML/QuasiMonteCarlo.jl#67 (comment) ?

Copy link

codecov bot commented Dec 12, 2023

Codecov Report

Attention: 12 lines in your changes are missing coverage. Please review.

Comparison is base (7f875be) 65.52% compared to head (9826638) 78.17%.
Report is 6 commits behind head on master.

Files Patch % Lines
src/Sampling.jl 69.69% 10 Missing ⚠️
src/GEK.jl 0.00% 1 Missing ⚠️
src/Kriging.jl 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           master     #446       +/-   ##
===========================================
+ Coverage   65.52%   78.17%   +12.65%     
===========================================
  Files          23       23               
  Lines        3115     3153       +38     
===========================================
+ Hits         2041     2465      +424     
+ Misses       1074      688      -386     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ChrisRackauckas ChrisRackauckas merged commit e47d74b into SciML:master Dec 13, 2023
6 of 8 checks passed
@ChrisRackauckas
Copy link
Member

Awesome!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants