Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add simple json report generation #195

Open
wants to merge 55 commits into
base: master
Choose a base branch
from
Open

Add simple json report generation #195

wants to merge 55 commits into from

Conversation

tuturu-tech
Copy link

@tuturu-tech tuturu-tech commented Aug 4, 2023 •
edited
Loading

Added very simple json report generation (only lines found/covered)

Issues:

  • Error var is overridden, looking for guidance on how best to handle this
  • html path is modified in order to replace the file name, looking for guidance here as well
  • Currently not generating branches/functions coverage

@montyly
Copy link
Member

montyly commented Aug 4, 2023

@tuturu-tech can you fix the issues reported by golangci-lint?

You can look at https://github.com/crytic/medusa/blob/01c8d9efc40ac13ae937a7cef3f1999290dca7b7/CONTRIBUTING.md#linters to see how to install and run it

@tuturu-tech tuturu-tech marked this pull request as ready for review August 4, 2023 16:20
@anishnaik anishnaik mentioned this pull request Jan 31, 2024
Closed
Xenomega and others added 21 commits July 8, 2024 18:25
@Xenomega @anishnaik @s4nsec
Update to go-ethereum 1.12.0 (#199)
194a782 
* Updated CallMessage to be compliant with core.Message made in new go-ethereum

---------

Co-authored-by: anishnaik <[email protected]>
@dependabot @s4nsec
Bump golang.org/x/net from 0.12.0 to 0.14.0 (#196)
2dddaf1 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.12.0 to 0.14.0.
- [Commits](golang/net@v0.12.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@anishnaik @Xenomega @s4nsec
console.log go brrr (#193)
ab00c59 
Introduce `console.log` functionality with string formatting capabilities.

---------

Co-authored-by: David Pokora <[email protected]>
@Xenomega @anishnaik @s4nsec
Added denomination parsing to AST value extraction (#202)
3172b53 
* Added denomination parsing to AST constant mining
* Added tests for AST value extraction, removed print from experimental code

---------

Co-authored-by: anishnaik <[email protected]>
@montyly @s4nsec
Update README.md (#184)
b911551
@anishnaik @s4nsec
Multi-channel and multi-error log support (#180)
931bba0
@anishnaik @s4nsec
Update version (#210)
aa82533
@Exca-DK @s4nsec
Support NoColor and --no-color (#222)
24ebcc4 
* Console output with optional coloring

* optional Colorize

* LF and CRLF line endings

* update no-color flag description

* code review changes

---------

Authored-by: Exca-DK <[email protected]>
@montyly @anishnaik @s4nsec
Update CONTRIBUTING.md (#185)
e370832 
Co-authored-by: anishnaik <[email protected]>
@dependabot @Xenomega
@anishnaik @s4nsec
Bump github.com/rs/zerolog from 1.29.0 to 1.30.0 (#186)
f2c956e 
Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.29.0 to 1.30.0.
- [Release notes](https://github.com/rs/zerolog/releases)
- [Commits](rs/zerolog@v1.29.0...v1.30.0)

---
updated-dependencies:
- dependency-name: github.com/rs/zerolog
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Pokora <[email protected]>
Co-authored-by: anishnaik <[email protected]>
@dependabot @anishnaik @s4nsec
Bump github.com/google/uuid from 1.3.0 to 1.3.1 (#215)
def06b2 
Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.3.0 to 1.3.1.
- [Release notes](https://github.com/google/uuid/releases)
- [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md)
- [Commits](google/uuid@v1.3.0...v1.3.1)

---
updated-dependencies:
- dependency-name: github.com/google/uuid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@dependabot @anishnaik @s4nsec
Bump golang.org/x/crypto from 0.12.0 to 0.13.0 (#226)
4b2dacf 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.12.0 to 0.13.0.
- [Commits](golang/crypto@v0.12.0...v0.13.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@dependabot @s4nsec
Bump github.com/rs/zerolog from 1.30.0 to 1.31.0 (#236)
b4e7547 
Bumps [github.com/rs/zerolog](https://github.com/rs/zerolog) from 1.30.0 to 1.31.0.
- [Release notes](https://github.com/rs/zerolog/releases)
- [Commits](rs/zerolog@v1.30.0...v1.31.0)

---
updated-dependencies:
- dependency-name: github.com/rs/zerolog
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@anishnaik @s4nsec
add setuptools to pip install line (#252)
f4f6605
@dependabot @anishnaik @s4nsec
Bump actions/checkout from 3 to 4 (#228)
914a144 
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@dependabot @anishnaik @s4nsec
Bump golang.org/x/crypto from 0.13.0 to 0.14.0 (#240)
ae4c36e 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.13.0 to 0.14.0.
- [Commits](golang/crypto@v0.13.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@anishnaik @s4nsec
Fix testAllContracts behavior (#253)
1f8afda
@damilolaedwards @anishnaik @s4nsec
Open non-zero coverage reports in corpus by default (#243)
8cc3957 
Co-authored-by: anishnaik <[email protected]>
@anishnaik @s4nsec
Fix warp cheatcode (#255)
9ad9ff2 
* fix warp cheatcode

* revert if warp input value is greater than type(uint64).max

* Make max uint64 a global value
@anishnaik @s4nsec
Explicitly reset the state trie's cache to prevent mem leak (#290)
7065f74
@dependabot @Xenomega @s4nsec
Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 (#257)
7f0c072 
Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/spf13/cobra/releases)
- [Commits](spf13/cobra@v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: github.com/spf13/cobra
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Pokora <[email protected]>
dependabot bot and others added 30 commits July 8, 2024 18:28
@dependabot @s4nsec
Bump github.com/google/uuid from 1.3.1 to 1.6.0 (#288)
6313c92 
Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.3.1 to 1.6.0.
- [Release notes](https://github.com/google/uuid/releases)
- [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md)
- [Commits](google/uuid@v1.3.1...v1.6.0)

---
updated-dependencies:
- dependency-name: github.com/google/uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot @Xenomega @s4nsec
Bump golang.org/x/net from 0.14.0 to 0.21.0 (#291)
b166363 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.14.0 to 0.21.0.
- [Commits](golang/net@v0.14.0...v0.21.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Pokora <[email protected]>
@Xenomega @s4nsec
Fix the copy length based panic in the parseBytes32 cheatcode (#293)
38ed335
@anishnaik @s4nsec
Enable all testing modes by default, update property mode testing, im…
6c13d2a 
…prove UX, allow for contracts to have starting balances, and fix coverage panic (#216)

* - merged all three testing modes
- created testing provider utils file to evaluate whether an abi.method is an optimization / property test
- updated fuzzer tests
- made default property test prefix "invariant_"

* enable all testing modes, update fuzzer tests

* add verification for config

* improve config-related errors

* update deploymentOrder to targetContracts

* update edge case where coverage is 0/0 lines

* add support for payable constructors

* linting

* fix bug

* fix panic and improve return data printing in execution trace

* encode bytes and byteX as hex strings

* fix console

* updates from PR review

* change config language
@anishnaik @s4nsec
fix OOB panic (#303)
57cc20c
@Xenomega @anishnaik @s4nsec
Added a unique exit code for failed tests, added generic way to bubbl…
6692150 
…e up errors with exit codes from cmd, organized exit code definitions into one package (#301)

Co-authored-by: anishnaik <[email protected]>
@Xenomega @anishnaik @s4nsec
Fix corpus call method resolution bug, improve startup logging (#308)
3320811 
* * Fixed a corpus call method resolution bug.
* Deprecated "methodName" in corpus (lack of support for function overloading). To be removed later, in favor of new "methodSignature" key.
* Improved fuzzer initialization logging
* Print basic metrics for corpus health on startup
* Reorder printing to avoid "Creating X workers" message after "fuzz: elapsed[...]" message.

* Update corpus health log for readability

---------

Co-authored-by: anishnaik <[email protected]>
@Xenomega @anishnaik @s4nsec
Add shrinking limits (#297)
c4b9d98 
* Add shrinking limits, improve "call removal" logic, fixed a bug where corpus results could re-record if replayed/reshrunk differently

* Removed comment indicating shrinkLimit must be greater than zero (untrue)

* Re-order unexecuted sequences so test result corpus items are replayed first

* change where shrinkIncrement is updated

---------

Co-authored-by: Anish Naik <[email protected]>
@anishnaik @s4nsec
update version (#310)
4a0f0c1
@damilolaedwards @s4nsec
Feat: snapshot and revertTo cheatcodes (#276)
3f6a58d
@0xalpharush @anishnaik @s4nsec
fix: attach execution trace to reverting properties (#335)
75ac86e 
Co-authored-by: anishnaik <[email protected]>
@0xalpharush @anishnaik @s4nsec
fix: use signature in traces to handle overloaded function names (#336)
c3127e4 
* fix: use signature in traces to handle overloaded function names

* fix test

---------

Co-authored-by: anishnaik <[email protected]>
@0xalpharush @anishnaik @s4nsec
feat: add execution trace for failed target contract deployments (#337)
e50b36d 
* feat: add execution trace for failed target contract deployments

* fix bugs in logging and improve trace output to console

---------

Co-authored-by: anishnaik <[email protected]>
@Xenomega @anishnaik @s4nsec
Output non-fuzzing failure related error messages (#312)
7fdab25 
* Output error message if there was one

* Slight cleanup/refactor

* Updated exit code and error return so error messages are only printed if there is an error (despite exiting with a special exit code)

* proposed changed to prevent double logging/printing of fuzzer errors

* change name of exit code

* fix bug

---------

Co-authored-by: anishnaik <[email protected]>
@elopez @s4nsec
Update README to reflect current CLI and config options (#343)
fa498d1 
Closes #341
@dependabot @s4nsec
Bump golang.org/x/crypto from 0.19.0 to 0.22.0 (#345)
c755683 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.19.0 to 0.22.0.
- [Commits](golang/crypto@v0.19.0...v0.22.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot @anishnaik @s4nsec
Bump google.golang.org/protobuf from 1.28.1 to 1.33.0 (#332)
f46c4e1 
Bumps google.golang.org/protobuf from 1.28.1 to 1.33.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@dependabot @anishnaik @s4nsec
Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 (#314)
42a16b0 
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.4 to 1.9.0.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](stretchr/testify@v1.8.4...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: anishnaik <[email protected]>
@konnov @s4nsec
fix two outdated comments (#347)
e58ae6e
@elopez @anishnaik @s4nsec
ci: automated release builds (#342)
74dbf0e 
* add M1 mac arch build and test

* Update .github/workflows/ci.yml

Co-authored-by: Emilio López <[email protected]>

* Update .github/workflows/ci.yml

Co-authored-by: Emilio López <[email protected]>

* ci: automate release creation when pushing a tag

* ci: upgrade actions/setup-{node,go}

* ci: fix Python dependency installation on macOS

  error: externally-managed-environment

  × This environment is externally managed
  ╰─> To install Python packages system-wide, try brew install
      xyz, where xyz is the package you are trying to
      install.

      If you wish to install a non-brew-packaged Python package,
      create a virtual environment using python3 -m venv path/to/venv.
      Then use path/to/venv/bin/python and path/to/venv/bin/pip.

      If you wish to install a non-brew packaged Python application,
      it may be easiest to use pipx install xyz, which will manage a
      virtual environment for you. Make sure you have pipx installed.

  note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.

* ci: use `alls-green` to decide success status

`release` can be skipped, but GitHub will then skip `all-checks`.
We need to check that `release` is successful when it runs, but ignore
it when it is skipped.

---------

Co-authored-by: Anish Naik <[email protected]>
@anishnaik @zachmdsi
@damilolaedwards @s4nsec
mdbook for medusa (#348)
68c5be2 
* Migrate to mdbook (#223)

Co-authored-by: Zach McManus <[email protected]>
Co-authored-by: Damilola Edwards <[email protected]>
@0xalpharush @s4nsec
fix: use the shrunken abi values as the msg's data (#374)
69a9979
@0xalpharush @s4nsec
chore: fix typos (#387)
5e5d0e0
@0xalpharush @s4nsec
feat: call constant methods occasionally and allow assertion testing …
827dbed 
…them (#363)

* feat: call constant methods ocassionally and allow assertion testing them

* add test
@0xalpharush @s4nsec
fix: re-encode calldata in mutator and refactor (#380)
8320d6e 
* fix: re-encode calldata in mutator and refactor

* panic on misuse
@0xalpharush @anishnaik @s4nsec
excluding compilation platform fallsback to default (#362)
3259c27 
* fix: excluding compilation platform fallsback to default

* warn if coverage is disabled

---------

Co-authored-by: anishnaik <[email protected]>
@0xalpharush @s4nsec
feat: display test cases discovered by the fuzzer (#382)
3cbe484 
* feat: display test cases discovered by the fuzzer

* check whether optimization test case has started
@tuturu-tech @s4nsec
fix json template, change htmlReportPath to corpus path
f37287f
@tuturu-tech @s4nsec
added html and json file path configs, updated report generation
ed6627f
@s4nsec
Remove duplicate member values passed to ProjectConfig
4fb3645
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Xenomega Xenomega Awaiting requested review from Xenomega Xenomega is a code owner

@anishnaik anishnaik Awaiting requested review from anishnaik anishnaik is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
10 participants
@tuturu-tech @montyly @Xenomega @anishnaik @Exca-DK @damilolaedwards @0xalpharush @elopez @konnov @s4nsec