Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

$/TB/year cost estimates #2

Open
jhpoelen opened this issue Sep 27, 2022 · 12 comments
Open

$/TB/year cost estimates #2

jhpoelen opened this issue Sep 27, 2022 · 12 comments

Comments

@jhpoelen
Copy link
Member

jhpoelen commented Sep 27, 2022

Michael D. shared a size/cost estimate for image storage - $258 / TB / yr on a estimated corpus of 145 TB

image

@jbest is this along the lines of what you are seeing?

@jbest
Copy link

jbest commented Sep 27, 2022

@jhpoelen We're expecting to pay ~$180/TB/yr

@jhpoelen
Copy link
Member Author

@jbest thanks for sharing! Sounds like you got a better deal than Michael D. did. I wonder what makes up for the price difference.

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 27, 2022

fyi @denslowm - now I am curious about the different rates that folks pay to storage / archive their specimen images. . . are you aware of any other project that may be willing to share their $ / TB / yr?

Also, I am curious whether you locked in a price for a specific amount of time, or whether you are at the mercy of the storage provider.

And, what the mitigation would be in case you'd want to move to a cheaper storage provider.

@jbest
Copy link

jbest commented Sep 27, 2022

@jhpoelen I don't know where MD got that rate but perhaps it was a full-fledged image server like BisQue or IIIF compliant? Maybe high uptime SLA? We're getting a very good deal at UT TACC but it's a bare bones file repository and HTTP service.

@jhpoelen
Copy link
Member Author

Many aspects to getting image storage services . . . wow must be tricky to make such a big decision.

@denslowm
Copy link

denslowm commented Sep 27, 2022

$258 /TB/yr was the rate from TACC / iPlant (now CyVerse) for our original proposal (2014). I know their rates have come down since that time. We have basically negotiated to stay with them until the end of 2023. This included at LOT more than just storage, but SERNEC really didn't leverage all of that. I can't speak for CyVerse, but I'm not sure if this is the kind of thing they want to keep doing going forward. [Edit - Yes , @jbest this includes usage of BisQue. I don't think that CyVerse is IIIF compliant, but IIIF has certainly been on my radar based on information from you and Nelson]

Several years ago, I priced out Amazon and Google and spinning disc estimates were much higher than CyVerse.

@jhpoelen Perhaps we could get iDigBio to do a survey of some sort. I think if we asked the right questions we could get a better comparison for the different offerings, but from my experience most TCNs didn't/don't have formal agreements so it would be interesting to find out.

@jhpoelen
Copy link
Member Author

@denslowm great idea about the survey. Just sent a short message to Gil Nelson and Jill Goodwin. Perhaps they can help forward the idea to interested parties.

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 28, 2022

from morphosource - via https://www.idigbio.org/wiki/index.php/BioDigiCon_2022

$ 0.17 / GB / year for expected 13.5 TB /yr volume growth

image

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 28, 2022

Media mobilization at Yale Peabody Museum via Nelson Rios at 2022-09-28 https://www.idigbio.org/wiki/index.php/BioDigiCon_2022

volume - 27 TB / 951k images.

Nelson shared that total estimate costs ~ $ / TB / yr ~ $300 a month at a rate of about $5/TB/Month.

image

image

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 28, 2022

@mkoo shared o Arctos Media aspects > 12TB of media via https://www.idigbio.org/wiki/index.php/BioDigiCon_2022

from Zoom chat -
image

image

image

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 28, 2022

for @nfranz Symbiota Support Hub -

image

from ASU-Services-and-Pricing-Structure-Research-Computing-Confluence-2022-09-28.pdf

Storage Protocols Purpose Free Starting Amount Cost per additionalTB per year
Project-based Storage NFS, SMB, Globus DTN Long term project file storage 100GB $50

image

image

image

@jhpoelen
Copy link
Member Author

jhpoelen commented Sep 28, 2022

So far, it appears we have the following cost / volume estimates:

location est. volume storage costs
@denslowm @ NEON 145TB $258 /TB/yr
@jbest @ BRIT ~13TB ? $180/TB/yr
@mkoo @ Arctos > 12TB TBA
@nfranz @ SSH 16TB $50 /TB/yr
Nelson Rios @ Yale Peabody 27 TB $5 /TB/yr
Julie Winchester @ Morphosource 76 TB $170 /TB/yr

please feel free to update comment / correct etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants