Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation of the github2prov Prototype Based on gitlab2prov Provenance Model #100

Draft
wants to merge 82 commits into
base: master
Choose a base branch
from

Commits on Nov 19, 2022

  1. Differentiate between gitlab and github instances

    Differentiate between gitlab and github instances when cloning a git repository using a token over https.
    cdboer committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    d9fd5f9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3ecf13c View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2022

  1. Add PyGithub to dependencies

    cdboer committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    2865e5e View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2022

  1. Configuration menu
    Copy the full SHA
    b49eae1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    beb5f9d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e4ca20c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    af35224 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5c58bb2 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    1f4a8ca View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8cea2ce View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    851564e View commit details
    Browse the repository at this point in the history
  9. Add token guide for github

    cdboer committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    18b6c02 View commit details
    Browse the repository at this point in the history
  10. Fix typo

    cdboer committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    cb3f0e0 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2023

  1. Update fetcher implementation

    cdboer committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    525b9f2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fd938c2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    634784a View commit details
    Browse the repository at this point in the history
  4. Update constants

    cdboer committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    2be0f6c View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ed20caa View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    300c8bf View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    60fb4d9 View commit details
    Browse the repository at this point in the history
  8. Update handlers

    cdboer committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    a9b1b9e View commit details
    Browse the repository at this point in the history
  9. Add new model implementation

    cdboer committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    277b7eb View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ae97b03 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    bce781f View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    ccfcf68 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2023

  1. Configuration menu
    Copy the full SHA
    61df234 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7650d0c View commit details
    Browse the repository at this point in the history
  3. 1 Configuration menu
    Copy the full SHA
    ab259d6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c0d23ad View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4651d73 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    a2d28da View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    49b04ad View commit details
    Browse the repository at this point in the history
  8. Update package exports

    cdboer committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    1ae70a7 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    14cf614 View commit details
    Browse the repository at this point in the history
  10. Add new commands

    cdboer committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    b064357 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    2ef9f8e View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    f9f18bb View commit details
    Browse the repository at this point in the history
  13. Update provenance operations

    cdboer committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    ff61032 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    d1202d7 View commit details
    Browse the repository at this point in the history
  15. Update 'UnitOfWork' import

    cdboer committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    348107a View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    8c3ad8b View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    19996b1 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    39d06d4 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    a90560e View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2023

  1. Configuration menu
    Copy the full SHA
    243e9b8 View commit details
    Browse the repository at this point in the history
  2. Spelling fix

    cdboer committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    b4074e7 View commit details
    Browse the repository at this point in the history
  3. Update commands

    cdboer committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    76596e1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1046d44 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    59f3d87 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    dbd614e View commit details
    Browse the repository at this point in the history
  7. Fix read/write option spelling

    cdboer committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    796c5e0 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    b4c744d View commit details
    Browse the repository at this point in the history
  9. Fix 'stats' spelling

    cdboer committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    55de7a9 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    0baac8e View commit details
    Browse the repository at this point in the history
  11. Update README.md

    cdboer committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    b243965 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Configuration menu
    Copy the full SHA
    f4c5439 View commit details
    Browse the repository at this point in the history
  2. Remove old test suite

    cdboer committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    e2ed0ea View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Update attribute tables

    cdboer committed May 22, 2023
    Configuration menu
    Copy the full SHA
    52f420d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c6c8498 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6678135 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9c21dfe View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    dbf2a98 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    12d7d87 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b37fba7 View commit details
    Browse the repository at this point in the history
  8. Add fixtures to conftest.py

    cdboer committed May 22, 2023
    Configuration menu
    Copy the full SHA
    35f1c41 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2023

  1. Configuration menu
    Copy the full SHA
    d69bba2 View commit details
    Browse the repository at this point in the history
  2. Add 'click' dependency, rename CLI entrypoints, and include 'schema.j…

    …son' in package data
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    564d0d5 View commit details
    Browse the repository at this point in the history
  3. Refactor ProvenanceContext and models to improve attribute usage and …

    …simplify document access
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    0db55bb View commit details
    Browse the repository at this point in the history
  4. Refactor domain object attributes for clarity

    - Renamed attributes for better clarity (e.g., inserted to insertions, start to �uthored_at)
    - Removed redundant attributes like ile_paths
    - Consolidated datetime attributes (start and end to �uthored_at and committed_at)
    - Standardized uid attribute to id across various domain classes
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    0638a9e View commit details
    Browse the repository at this point in the history
  5. Enhance CLI commands and streamline configuration handling

    - Improved naming clarity: Renamed command groups from gitlab_cli to gitlab2prov and github_cli to github2prov.
    - Refined config validation and loading: Split invoke_command_line_from_config to separate functions for loading and validation (load_and_validate_config) and command execution (execute_command_from_config).
    - Introduced clear separation between loading and validation of config to provide clearer error messages.
    - Replaced --verbose option with --explain for statistics command for better understanding of its purpose.
    - Minor cleanups: Removed unnecessary whitespace and lines.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    cfd9b48 View commit details
    Browse the repository at this point in the history
  6. Refactor ProjectUrl and improve URL parsing

    - Introduced post-initialization method __post_init__ to parse the URL upon object creation, thus reducing repetitive calls to urlsplit.
    - Simplified slug property logic by utilizing the parsed URL path directly, ensuring clearer and more concise code.
    - Removed individual properties for
    etloc and scheme in favor of the parsed attributes from __post_init__.
    - Streamlined the clone_url method by removing redundant parameters and leveraging a dictionary lookup for platform-specific URLs.
    - Adapted child classes GitlabProjectUrl and GithubProjectUrl to match the streamlined method signature.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    93e5cfa View commit details
    Browse the repository at this point in the history
  7. Update Git fetcher with additional commit and revision attributes

    - Add 'deletions', 'insertions', 'lines', and 'files_changed' attributes to 'extract_commits'.
    - Rename 'start' to 'authored_at' and 'end' to 'committed_at' in 'extract_commits'.
    - Add 'insertions', 'deletions', 'lines', and 'score' attributes to 'FileRevision' in 'extract_revisions'.
    - Correct typo in comment from 'remeber' to 'remember' in 'extract_revisions'.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    768ff9d View commit details
    Browse the repository at this point in the history
  8. Refactor GithubAnnotationParser and Enhance Annotation Validation

    - Introduced a ilter_valid method to filter annotations without �nnotator or start values.
    - Modified parse method to use ilter_valid after sorting annotations.
    - Changed property name uid to id in methods: parse_commit_comment, parse_commit_status, parse_award_reaction, parse_issue_comment, and parse_issue_event.
    - Removed extraneous whitespace after parse_award_reaction method.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    bfc8500 View commit details
    Browse the repository at this point in the history
  9. Update Annotation Property Name in GitlabAnnotationParser

    - Replaced uid with id in the methods for parsing notes, comments, awards, and labels.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    f5c9218 View commit details
    Browse the repository at this point in the history
  10. Refactor and Enhance Provenance Operations

    - Improved docstrings for clarity in various methods.
    - Updated error handling in the 
    ead_provenance_file method to handle file not found exceptions.
    - Refactored the deserialize_string method to provide better feedback on deserialization failures.
    - Modified the file write mode in write_provenance_file based on the overwrite parameter.
    - Enhanced ASCII table formatting in ormat_stats_as_ascii_table.
    - Introduced new methods for pseudonymization:
      - generate_pseudonym
      - pseudonymize_agent
      - pseudonymize_relation
      - Overhauled existing pseudonymize method for better clarity and efficiency.
    cdboer committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    35dd383 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    6a86b1b View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Update config file example

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    01c28b2 View commit details
    Browse the repository at this point in the history
  2. Update README.md

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    f93d403 View commit details
    Browse the repository at this point in the history
  3. Update README title

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    66c591f View commit details
    Browse the repository at this point in the history
  4. Update README title

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    f87a18f View commit details
    Browse the repository at this point in the history
  5. Update README title

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    d28ee4d View commit details
    Browse the repository at this point in the history
  6. Update node attribute tables

    cdboer committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    56818ca View commit details
    Browse the repository at this point in the history