Skip to content
This repository has been archived by the owner on Sep 1, 2022. It is now read-only.

Mismatch between suggested and actual alert counts #20

Open
adityasharad opened this issue Jan 29, 2020 · 0 comments
Open

Mismatch between suggested and actual alert counts #20

adityasharad opened this issue Jan 29, 2020 · 0 comments
Assignees

Comments

@adityasharad
Copy link
Collaborator

The CSVs of expected results seems to include all raw results of the query (including those not present within the database source archive root). In the VS Code IDE, these correspond to the #select table in the results view.
However, since the suggested template query has the problem metadata, the user is likely to see results in the alerts view, which filters out results in files outside the source archive root.

This leads to a mismatch in numbers, e.g. step 09 of the segv CTF has 70 results in the alerts view and 98 results in the #select view, and if you submit an incorrect solution it tells you it expects 98.

This suggests we need to either:

  • use only the interpreted alerts within the source archive in the expected results files, or
  • better explain the result counts.
@xcorail xcorail self-assigned this Mar 3, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants
@adityasharad @xcorail and others