Skip to content
This repository has been archived by the owner on Feb 1, 2024. It is now read-only.

Abstract harvester parsers #44

Open
mjaquiery opened this issue Feb 22, 2023 · 0 comments
Open

Abstract harvester parsers #44

mjaquiery opened this issue Feb 22, 2023 · 0 comments
Labels
AmpLabs Decomposition to help AmpLabs enhancement New feature or request harvester Harvester code (Python)

Comments

@mjaquiery
Copy link
Collaborator

The harvesters' parsing scripts are included directly within the harvester code.
Harvesters would be more extensible if they could rely on Python library plugins as parsers.

  • Register parser plugins somewhere
  • Dynamically download missing plugins
  • Provide a mechanism for determining which plugin to use on which files
  • Release code for current parsers as separate python packages
  • Solidify and plublicise InputFile class as generic target class for plugins
  • Provide documentation on how to write custom plugins
    • Provide description of InputFile data representation to support conversion to different output formats
@mjaquiery mjaquiery added enhancement New feature or request harvester Harvester code (Python) AmpLabs Decomposition to help AmpLabs labels Feb 22, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
AmpLabs Decomposition to help AmpLabs enhancement New feature or request harvester Harvester code (Python)
Projects
None yet
Development

No branches or pull requests

1 participant