Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]: All examples should have a unique output filename #2033

Closed
2 tasks done
dagardner-nv opened this issue Nov 1, 2024 · 0 comments · Fixed by #2049
Closed
2 tasks done

[FEA]: All examples should have a unique output filename #2033

dagardner-nv opened this issue Nov 1, 2024 · 0 comments · Fixed by #2049
Assignees
Labels
feature request New feature or request

Comments

@dagardner-nv
Copy link
Contributor

Is this a new feature, an improvement, or a change to existing functionality?

Improvement

How would you describe the priority of this feature request

Low (would be nice)

Please provide a clear description of problem this feature solves

It would be nice when validating workflows if the output of one pipeline didn't overwrite the output of another

Describe your ideal solution

Each output file includes the workflow name ex: log-parsing-output.jsonlines
rather than output.jsonlines

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
  • I have searched the open feature requests and have found no duplicates for this feature request
@dagardner-nv dagardner-nv added the feature request New feature or request label Nov 1, 2024
@dagardner-nv dagardner-nv self-assigned this Nov 1, 2024
@morpheus-bot-test morpheus-bot-test bot moved this from Todo to Review - Ready for Review in Morpheus Boards Nov 7, 2024
@mdemoret-nv mdemoret-nv added this to the 25.02 - Release milestone Nov 20, 2024
rapids-bot bot pushed a commit that referenced this issue Nov 22, 2024
* Ensure each example pipeline produces a unique output file name
* Add expected example output filenames to `.gitignore`
* Update `ransomware_detection` pipeline to include a unique column
* Update `ransomware_detection` adding a `--pipeline_batch_size` flag defaulting to the `model_max_batch_size` avoiding a config warning
* Update `Config` to call `_validate_config` from `Config.freeze` instead of the attribute setters, avoids issue where setting attributes becomes order dependent ex:
```python
from morpheus.config import Config
config = Config()
config.model_max_batch_size = 1024 # This line triggers a warning
config.pipeline_batch_size = 1024
```

Includes changes from PR #2040

Closes #2033
Closes #2035

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #2049
@github-project-automation github-project-automation bot moved this from Review - Ready for Review to Done in Morpheus Boards Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants