Search S3 if `granules` are not Explicitly Provided #50

AndrewPlayer3 · 2024-10-02T20:03:04Z

TODO:

update changelog

src/hyp3_srg/utils.py

jth changes to `search-s3`

…search-s3

environment.yml

…search-s3

src/hyp3_srg/utils.py

src/hyp3_srg/time_series.py

src/hyp3_srg/utils.py

Co-authored-by: Jake Herrmann <[email protected]>

Jth search s3 updates

AndrewPlayer3 added 4 commits October 2, 2024 15:19

search s3 bucket&prefix for granules if none provided

78314e3

updated changelog

981d7a9

filter to only s1[ab]_iw_raw when searching s3

795b71c

raise error if both gslc-bucket and granules are provided

ef0d7d1

AndrewPlayer3 added the patch Bump the patch version number of this project label Oct 2, 2024

AndrewPlayer3 added 6 commits October 2, 2024 16:43

moved s3 functions to utils

f17be66

added test for getting gslc uris from s3

1ef9f09

moved tests for s3 functions

0905b01

removed unused import

00a0303

corrected changelog

723873a

better changelog

762f240

AndrewPlayer3 marked this pull request as ready for review October 3, 2024 16:08

AndrewPlayer3 requested a review from a team as a code owner October 3, 2024 16:08

jtherrmann reviewed Oct 3, 2024

View reviewed changes

src/hyp3_srg/utils.py Show resolved Hide resolved

jtherrmann added 9 commits October 4, 2024 14:43

simplify gslc s3 search interface, fix pycharm warnings

d880b47

temp hard-code granules sub-prefix, fix a typo

5c04c22

add --use-granules-from-s3 option

c7464cc

remove unexpected kwarg

8c84b23

update time_series --bounds interface to match back_projection

09e1531

finish implementing gslc prefix option

f06485c

check if bucket and bucket_prefix given in back_projection workflow

0081c55

newlines

e50a7e2

Merge pull request #51 from ASFHyP3/jth-search-s3

6d580b4

jth changes to `search-s3`

jtherrmann marked this pull request as draft October 11, 2024 00:04

AndrewPlayer3 and others added 5 commits October 11, 2024 14:48

rename dockerfile for test purposes

a781acf

pin python to <3.13 due to hyp3lib bug

b8dc431

Merge branch 'search-s3' of github.com:ASFHyP3/hyp3-srg into search-s3

36a52de

testing multiple docker build

512de27

Merge branch 'search-s3' of https://github.com/asfhyp3/hyp3-srg into …

a00f8bb

…search-s3

AndrewPlayer3 marked this pull request as ready for review October 14, 2024 17:47

jtherrmann added 3 commits October 14, 2024 11:27

add todo

4a8d440

pin to actions develop

183bd48

remove failure for particular granule

6f7866d

jtherrmann reviewed Oct 15, 2024

View reviewed changes

environment.yml Outdated Show resolved Hide resolved

AndrewPlayer3 and others added 9 commits October 15, 2024 12:11

renamed docker files

ad1adc3

Merge branch 'search-s3' of https://github.com/asfhyp3/hyp3-srg into …

de18cff

…search-s3

pin docker action to latest release

36a0f05

update changelog, revert python pin

604dea6

changelog version

5ab1d46

remove old todo

54f8e6b

changelog tweak

180f1b5

remove references to manually pushing gpu image

f4bb3b8

Merge branch 'search-s3' of https://github.com/asfhyp3/hyp3-srg into …

441b41a

…search-s3

jtherrmann reviewed Oct 15, 2024

View reviewed changes

src/hyp3_srg/utils.py Outdated Show resolved Hide resolved

jtherrmann reviewed Oct 15, 2024

View reviewed changes

src/hyp3_srg/time_series.py Outdated Show resolved Hide resolved

jtherrmann reviewed Oct 15, 2024

View reviewed changes

src/hyp3_srg/time_series.py Outdated Show resolved Hide resolved

AndrewPlayer3 added 3 commits October 15, 2024 15:18

removed unnecessary checks

aa2a427

move s3 to global scope

4a656d5

simplified search s3 function and removed test

27af46a

jtherrmann reviewed Oct 15, 2024

View reviewed changes

src/hyp3_srg/utils.py Outdated Show resolved Hide resolved

AndrewPlayer3 and others added 2 commits October 15, 2024 15:54

Update src/hyp3_srg/utils.py

62a4f82

Co-authored-by: Jake Herrmann <[email protected]>

Merge pull request #56 from ASFHyP3/jth-search-s3-updates

76dd5e0

Jth search s3 updates

jtherrmann approved these changes Oct 15, 2024

View reviewed changes

imports

c2eed41

jtherrmann approved these changes Oct 15, 2024

View reviewed changes

jtherrmann added 2 commits October 15, 2024 14:14

fix actions tags

46dd802

python 3.13

7e82cc7

jtherrmann approved these changes Oct 15, 2024

View reviewed changes

AndrewPlayer3 merged commit 7ff2da7 into develop Oct 16, 2024
10 checks passed

AndrewPlayer3 deleted the search-s3 branch October 16, 2024 17:26

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Search S3 if `granules` are not Explicitly Provided #50

Search S3 if `granules` are not Explicitly Provided #50

AndrewPlayer3 commented Oct 2, 2024 •

edited by jtherrmann

Loading

Search S3 if granules are not Explicitly Provided #50

Search S3 if granules are not Explicitly Provided #50

Conversation

AndrewPlayer3 commented Oct 2, 2024 • edited by jtherrmann Loading

Search S3 if `granules` are not Explicitly Provided #50

Search S3 if `granules` are not Explicitly Provided #50

AndrewPlayer3 commented Oct 2, 2024 •

edited by jtherrmann

Loading