Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fuzz testing #15

Open
NMAC427 opened this issue Jul 20, 2023 · 0 comments
Open

Fuzz testing #15

NMAC427 opened this issue Jul 20, 2023 · 0 comments
Labels
enhancement New feature or request testing

Comments

@NMAC427
Copy link
Member

NMAC427 commented Jul 20, 2023

It would be greate if at some point we could implement automatic fuzz testing to ensure that there are no bugs hiding. There is an incredible amount ways in which a user can combine expressions and verbs. Using manual testing, we'll never be able to cover all possible cases.

There are many different things that we could test with fuzzing, but probably the simplest would be to randomly generate valid symbolic expressions and then running them on different backends to check that they all either produce the same result or raise NotImplementedError.

(Randomly generating valid expressions, while not trivial, should be doable, because for each operator we have a type signature).

@NMAC427 NMAC427 added the enhancement New feature or request label Jul 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request testing
Projects
None yet
Development

No branches or pull requests

2 participants