2024.1.0 - Initial release with Dark Blue APTrust integration
What's Changed
- Remote refactor by @ssciolla in #1
- Add
README.md
(DBAI-10) by @ssciolla in #3 - Add
ArchivematicaAPI
and beginnings ofrun_dark_blue.rb
(DBAI-3) by @ssciolla in #2 - Add test runner using
rake
(DBAI-12) by @ssciolla in #6 Work
->ObjectMetadata
, and improve/fixBagTag
(DBAI-16, DBAI-17) by @ssciolla in #5Remote
->RemoteClient
refactor, add and improve tests (DBAI-15) by @ssciolla in #4- Add
SftpRemoteClient
, wire up integration from Archivematica AIP Storage to APTrust (DBAI-13) by @ssciolla in #7 - Add back
dry_run
tocreate_config
, updaterun_example.rb
by @ssciolla in #8 - Adopt
semantic_logger
, add log level to the configuration (DBAI-6) by @ssciolla in #9 - Log progress of AWS S3 uploads at
:debug
level (DBAI-20) by @ssciolla in #11 - Process objects for one or more Archivematica instances (DBAI-21) by @ssciolla in #10
- Fix broken
AwsS3RemoteClient
tests after progress addition (DBAI-20) by @ssciolla in #13 - Containerize Dark Blue job (DBAI-22) by @ssciolla in #12
- Use
RemoteClientDataTransfer
withBagCourier
to reduce copies (DBAI-26) by @ssciolla in #15 - Fix a couple issues related to
ArchivematicaService
/DarkBlueJob
refactoring (DBAI-26) by @ssciolla in #16 - Add
mariadb
database, implement full versions ofBag
andStatusEvent
repositories (DBAI-4) by @ssciolla in #14 - Switch APTrust "Storage-Option" to "Glacier-Deep-OR" (DBAI-28) by @ssciolla in #18
- Align
config.rb
andconfig.example.yml
by @ssciolla in #19 - Introduce
RepositoryPackage
/Repository
persistence, filter Archivematica packages by stored time (DBAI-23) by @ssciolla in #20 - Fix time filter by ensuring microsecond precision (DBAI-23) by @ssciolla in #22
- Improve error handling in
BagCourier
, add some tests (DBAI-36) by @ssciolla in #24 - Make
ObjectSizeLimit
optional in preparation for deployment, introducePackageFilter
(DBAI-32) by @ssciolla in #23 - Readded the changes for Bag validator after resolving conflicts by @jayamala17 in #26
- Re-use Faraday config using
APIBackend
, createAPTrustAPI
,APTrustVerifier
, and verification job (DBAI-25) by @ssciolla in #21 - Added
BagStatus
(DBAI-30) by @jayamala17 in #28 - Handling race condition (DBAI-38) by @jayamala17 in #30
- Update
sftp
, exclude previous run artifacts from images by @ssciolla in #27 - Allow users to re-deliver previously processed packages (DBAI-34) by @ssciolla in #29
- Prevent error/warning from AWS when running tests (DBAI-31) by @ssciolla in #31
- Improve
APIError
logic and handling (DBAI-43) by @ssciolla in #34 - Add GitHub Actions workflow for build (DBAI-44) by @ssciolla in #35
- Tweak build workflow (DBAI-44) by @ssciolla in #36
- Support additional arbitrary key/value pairs in
bag-info.txt
, specify values for Dark Blue (DBAI-19) by @ssciolla in #33 - Run test suite using GitHub Actions (DBAI-11) by @ssciolla in #32
- Refactor
Config
module to use environment variables, improve validation (DBAI-18) by @ssciolla in #38 - Fix missed usage of
get_value
without key (DBAI-18) by @ssciolla in #39 - DBAI-29 Canister Implementation by @jayamala17 in #37
- Improve file operations (DBAI-45) by @ssciolla in #42
- Improve logging (DBAI-37) by @ssciolla in #43
- Specify expected errors, handle
MultipartUploadError
(DBAI-40) by @ssciolla in #44 - Add setting to only process a limited number of objects per run (DBAI-51) by @ssciolla in #46
- Fix CVGA prefix in
config
by @ssciolla in #47 - Add script for restoring to staging (DBAI-46) by @ssciolla in #40
- Add Prometheus metrics for DarkBlue Service by @jayamala17 in #48
- Refactor
Dispatcher
(DBAI-42) by @ssciolla in #45 - Update storage location UUID key name (DBAI-7) by @ssciolla in #50
- Bump rexml from 3.2.6 to 3.2.7 by @dependabot in #51
- Added the cluster namesapce to handle the metrics between stage and prod by @jayamala17 in #52
- Refactor
verify_aptrust
to use more efficient query (DBAI-53) by @ssciolla in #53 - Make Metrics optional to support Ruby only development, update
README.md
with Prometheus info (DBAI-55) by @ssciolla in #54 - Add build-release GitHub Action (DBAI-56) by @ssciolla in #55
New Contributors
- @jayamala17 made their first contribution in #26
- @dependabot made their first contribution in #51
Full Changelog: https://github.com/mlibrary/bag-courier/commits/2024.1.0