Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change this forks "Scanner" tag to something different #315

Closed
wants to merge 19 commits into from

Commits on Sep 17, 2023

  1. Revert "Remove urllib3 dependency"

    This reverts commit 0911477.
    
    urllib3 is needed to postprocess/parse/URL for sanitization and privacy purpose (bibanon#192)
    drzraf committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    d838711 View commit details
    Browse the repository at this point in the history
  2. IA currently leaks the IP address of the submitter. This is bad.

    We fix this by carefully redacting the IP address in the JSON fields known to contain it.
    drzraf committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    add619c View commit details
    Browse the repository at this point in the history
  3. added tests

    drzraf committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    7cb7b3e View commit details
    Browse the repository at this point in the history
  4. flake8 linting

    drzraf committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    402ae19 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Dont leak ip address (bibanon#310)

    * Revert "Remove urllib3 dependency"
    
    This reverts commit 0911477.
    
    urllib3 is needed to postprocess/parse/URL for sanitization and privacy purpose (bibanon#192)
    
    * IA currently leaks the IP address of the submitter. This is bad.
    
    We fix this by carefully redacting the IP address in the JSON fields known to contain it.
    
    * added tests
    
    * flake8 linting
    drzraf authored Sep 18, 2023
    Configuration menu
    Copy the full SHA
    9c2ae72 View commit details
    Browse the repository at this point in the history
  2. URLlib3 dependency version lift

    - Use latest urllib3 instead of that specific version
    vxbinaca authored Sep 18, 2023
    Configuration menu
    Copy the full SHA
    a7d8b42 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Idempotency: Keep a local "archive" (index) of files successfully upl…

    …oaded the way
    
      yt-dlp keep track of downloaded items.
    
    - Amend bibanon#19 by adding optional idempotency between runs:
      While concurrent-instances can still rely on a "clean" download directory (bibanon#19)
      a single upload node can use --use-upload-archive can avoid source files removal.
      Subsequent runs of `tubeup` will omit files already uploaded.
    
    - Fixes bibanon#23 (and part of bibanon#233)
    - NB: Ability for upload_ia() to return None, paves the way to fix bibanon#36 or bibanon#109
    drzraf committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    d0b9df6 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Configuration menu
    Copy the full SHA
    545c8fe View commit details
    Browse the repository at this point in the history
  2. Ability, from an existing info-file, to upload existing associated me…

    …dia files.
    
    If `tubeup` is passed the path of info.json files instead of URL,
    then it will parse them and, if `--output` was set correctly (same value as previous `yt-dlp`)
    then recover the basename of the local files associated with this video.
    
    If used intelligently, especially in conjunction with:
    --ignore-existing-item # needed, for now, to avoid the download-archive codepath
    --yt=--format=...      # use the same download format
    --yt=--no-overwrites
    ... then existing files may be uploaded without having been re-downloaded/overwritten.
    
    Usage isn't foolproof. Use at your own risks.
    drzraf committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    a52031c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    40f1730 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Configuration menu
    Copy the full SHA
    33a8573 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f6c7115 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8777dfa View commit details
    Browse the repository at this point in the history
  4. playlist: Omit empty playlists

    drzraf committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    ff0c21f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e962f21 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4aaa6e7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e32cee9 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    6f9cc30 View commit details
    Browse the repository at this point in the history
  9. doc: README.md, list changes

    drzraf committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    055302b View commit details
    Browse the repository at this point in the history