its-live-monitoring v0.5.9

Changed

• Improved deduplication performance by searching HyP3's dynamodb directly for PENDING and RUNNING jobs, instead of using the hyp3_sdk.

Fixed

• Mixed STAC Item datetime formats (e.g., occasionally not including microseconds) in the list of secondary scenes no longer causes a ValueError to be raised.

its-live-monitoring v0.5.8

Changed

• As an incremental improvement to deduplication performance, its-live-monitoring now:
  • searches the s3://its-live-data bucket directly for already published (succeeded) pairs.
  • searches HyP3 ITS_LIVE via the API for pairs still pending or running, instead of searching for all previously submitted pairs.
• Upgrade numpy from 1.26.4 to 2.1.3

its-live-monitoring v0.5.7

Fixed

• Normalized the Sentinel-2 tile list to match the Element84 STAC representation, fixing tiles with a leading 0 being excluded from processing.

its-live-monitoring v0.5.6

Changed

• Reduced SQS batch size from 10 to 1 so that each de-duplication attempt has up to the full 15-minute Lambda timeout.

its-live-monitoring v0.5.5

Fixed

• Reduced maximum concurrent executions of the its_live_monitoring lambda from 1,000 to 100 to reduce the frequency of
  hyp3_sdk.exceptions.ServerError exceptions when de-duplicating new jobs. See #119.

its-live-monitoring v0.5.4

Fixed

• Convert the FilterPolicy property of the LandsatSubscription CloudFormation resource from JSON to YAML, to allow upgrading to cfn-lint v1.3.4 (see aws-cloudformation/cfn-lint#3403).
• Disqualify Sentinel-2 scenes from reprocessing campaigns before querying the STAC catalog.

its-live-monitoring v0.5.3

Fixed

• Downgraded the HyP3 SDK to v6.1.0 from v6.2.0 due to timeouts related to checking user's application status, see ASFHyP3/hyp3-sdk#280.

its-live-monitoring v0.5.2

Changed

• Sentinel-2 products are now disqualified from processing if they do not have enough data coverage.
• Sentinel-2 products are now disqualified from processing if the secondary scene's relative orbit does not match that of the reference scene.
• Switched from Dataspace's Sentinel-2 STAC API to Element84's.

its-live-monitoring v0.5.1

Fixed

• Sentinel-2 search geometry now uses a small central square within a tile instead of a tile's bbox to avoid finding images from neighboring tiles.
• its-live-monitoring now deploys the Sentinel-2 SNS subscription to the eu-west-1 region since subscriptions are required to be in the same regions as the SNS Topic.

its-live-monitoring v0.5.0

Note: Failed to deploy.

Added

• Support for processing Sentinel-2 SNS messages and submitting jobs to hyp3-its-live has been added

Changed

• To manage any lag between Sentinel-2 messages being published in AWS and scenes being available in Google Cloud, which is where hyp3-autorift pulls scenes from, the message failure handling has been changed:
  • The visibility timeout (time between attempts) has been extended from 5 minutes to 8 hours
  • Processing messages will be attempted 3 times before being driven to the dead letter queue
• The its_live_monitoring lambda timeout has been increased to 900 seconds, from 300 seconds, because pair picking for Sentinel-2 takes significantly longer due to the Copernicus Dataspace STAC catalog not supporting metadata queries