Only run benchmarks for PRs that modify code

[simu]

Checklist

• The PR has a meaningful title. The title will be used to auto generate the changelog
• PR contains a single logical change (to build a better changelog).
• Categorize the PR by setting a good title and adding one of the labels:
  bug, enhancement, documentation, change, breaking, dependency, internal
  as they show up in the changelog

[simu]

TODO: consider if we want to disable more checks for non-code changes