Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Log stack #39

Closed
wants to merge 25 commits into from
Closed

Log stack #39

wants to merge 25 commits into from

Conversation

Lewih
Copy link
Collaborator

@Lewih Lewih commented Jul 26, 2022 •
edited
Loading

PR with the configurations and settings that enable the use of the Grafana, Loki, promtail stack to visualise the logs.
Requires ReFrame 3.12 or newer.

Logs are saved in json in a per line fashion.

TODO

  • Add Loki query variables to Grafana for metrics. Ask on Grafana Loki slack.
  • Tackle this issue with the reframe community in order to have complete logging features.
  • Improve Readability of the logs (add more labels at scraping time).
  • Add stack configuration file to the repository
  • Consider the addition of influxdb
  • Monitor the evolution of the httpjson log handler with the reframe community in order to send data directly to the service node.
  • Change nomenclature for naming consistency: hortense -> dodrio
  • Give access to the dashboard to vsc admins.
  • VSC moved to 3.12

Screenshot 2022-07-25 at 19 06 17
Screenshot 2022-08-03 at 21 05 42

Lewih and others added 19 commits July 17, 2022 16:23
@Lewih
mode based run system. Added configurations for unified log repository.
a2d5d48
@Lewih
created 2 run files
9999699
@Lewih
append logs and output by default, removed timestamp from folder tree…
ac79d72 
… structure
@Lewih
different log and out files per site
226c203
@Lewih
debug2 flag
d0baf4b
@Lewih
update gitignore
e18053d
@Lewih
add standard mode: execute everythin but intensive and flexible
77eb8e4
@Lewih
syntax hotfix
6a86760
@Lewih
polished logging directory tree, more info in perf logging
38b7222
@Lewih
Updated config file and run file
db4f359
@Lewih
Compressed report, reframe 3.12.0 necessary
4eff6e6
@Lewih
module load 3.12
2dfca4f
@Lewih
Merge branch 'vscentrum:main' into log-stack
9e4e8a2
@Lewih
better log directory structure, newline at end report
8c82feb
@Lewih
json logs
fb733e8
@Lewih
fix json syntax
2e7cf44
@Lewih
nocolor output for better logging
505a9d7
@Lewih
fix json syntax
4838f06
@Lewih
Merge branch 'log-stack' of https://github.com/Lewih/vsc-test-suite i…
cb49ed2 
…nto log-stack
@Lewih Lewih marked this pull request as draft July 26, 2022 19:46
@Lewih Lewih linked an issue Jul 29, 2022 that may be closed by this pull request
Reframe Output Readability #35
Open
@Lewih Lewih mentioned this pull request Jul 31, 2022
Closed
@Lewih Lewih linked an issue Jul 31, 2022 that may be closed by this pull request
use VSC_SCRATCH for prefix and output #40
Closed
@Lewih Lewih closed this Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Reframe Output Readability use VSC_SCRATCH for prefix and output
1 participant
@Lewih