Number precision in Quantities #292
Closed
sebastian-peter
started this conversation in
General
Replies: 3 comments 1 reply
-
I see. Is the conversion taking place in the indriya package? Which would then make it hard to change right? |
Beta Was this translation helpful? Give feedback.
1 reply
-
Albeit an being an old article, this gives an idea of how |
Beta Was this translation helpful? Give feedback.
0 replies
-
This has become obsolete after switching to squants. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently, a lot of Quantity numbers are converted to
BigDecimal
during operations like unit conversions or multiplications (cf. profiling of a SIMONA run with mobility sim). Since Quantities are constructed withdouble
precision in PSDM, I don't think this is intended for our use case, especially becauseBigDecimals
(which are based onBigInteger
) are significantly slower than doubles during standard operations.All of this is given narrowing is disabeld, which seems to affect execution speed as well.
Beta Was this translation helpful? Give feedback.
All reactions