-
Notifications
You must be signed in to change notification settings - Fork 14
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #421 from sbesson/ftp_rocky
Migration of the IDR FTP service to Rocky Linux 9
- Loading branch information
Showing
7 changed files
with
6 additions
and
108 deletions.
There are no files selected for viewing
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,33 +1,11 @@ | ||
# IDR upload server | ||
|
||
The IDR upload VM includes FTP and S3 services for handling data submissions. | ||
The IDR upload VM includes a FTP service for handling data submissions especially | ||
in the early stage where sample data requires some testing. | ||
|
||
|
||
## IDR FTP server | ||
## IDR FTP service | ||
|
||
The IDR FTP server runs in Docker, and only allows [passive anonymous write-only uploads](https://github.com/ome/ansible-role-anonymous-ftp/). | ||
The IDR FTP service runs in Docker, and only allows [passive anonymous write-only uploads](https://github.com/ome/ansible-role-anonymous-ftp/). | ||
The server listens on port `21`, with data connections on ports `32022-32222`. | ||
Incoming uploads will appear on the server under `/data/idrftp-incoming/`. | ||
|
||
|
||
## IDR S3 upload server | ||
|
||
The IDR S3 submission server is co-located with the IDR FTP server. | ||
The IDR S3 server is actually a proxy through to the backend S3 filestore provided by EBI, and uses Minio's support for proxying S3 whilst overlaying its own authentication. | ||
|
||
Details of how this works are in the [`ome.minio-s3-gateway` Ansible role](https://github.com/ome/ansible-role-minio-s3-gateway). | ||
|
||
Users are created and removed using the `/usr/bin/minio-user.sh` script. | ||
For example, to add a new user `user-test`: | ||
|
||
sudo minio-user.sh add user-test | ||
|
||
The S3 access and secret key will be printed to stdout, and can be passed to the submitter who will be able to write and read to `https://idr-ftp.openmicroscopy.org/idr-upload/user-test/` using an S3 client. | ||
|
||
To remove a user run: | ||
|
||
sudo minio-user.sh remove user-test | ||
|
||
This only deletes the user credentials, it does not delete any data. | ||
|
||
Run the script without arguments for full help. |