Skip to content

Commit

Permalink
Merge pull request #105 from gmasse/main
Browse files Browse the repository at this point in the history
OVHcloud update
  • Loading branch information
sergeyk authored May 20, 2024
2 parents c3988ab + 0d4b8c9 commit 1d4004c
Show file tree
Hide file tree
Showing 3 changed files with 16 additions and 7 deletions.
18 changes: 12 additions & 6 deletions docs/cloud-gpus/cloud-gpus.csv
Original file line number Diff line number Diff line change
Expand Up @@ -204,12 +204,18 @@ Oblivus Cloud,RTX5000 (16 GB),Turing,4,64,16,64,3.04,0.76,,
Oblivus Cloud,RTX4000 (8 GB),Turing,1,8,4,16,0.41,0.27,,
Oblivus Cloud,RTX4000 (8 GB),Turing,2,16,8,32,0.82,0.27,,
Oblivus Cloud,RTX4000 (8 GB),Turing,4,32,16,64,1.64,0.27,,
OVHcloud,V100 (16 GB),Volta,1,16,8,45,1.97,1.97,,t1-45
OVHcloud,V100 (16 GB),Volta,2,32,18,90,3.94,1.97,,t1-90
OVHcloud,V100 (16 GB),Volta,4,64,36,180,7.89,1.97,,t1-180
OVHcloud,V100 (32 GB),Volta,1,32,14,45,2.19,2.19,,t2-45
OVHcloud,V100 (32 GB),Volta,2,64,28,90,4.38,2.19,,t2-90
OVHcloud,V100 (32 GB),Volta,4,128,56,180,8.76,2.19,,t2-180
OVHcloud,V100 (16 GB),Volta,1,16,8,45,0.77,0.77,,t1-le-45
OVHcloud,V100 (16 GB),Volta,2,32,18,90,1.55,0.77,,t1-le-90
OVHcloud,V100 (16 GB),Volta,4,64,36,180,3.1,0.77,,t1-le-180
OVHcloud,V100 (32 GB),Volta,1,32,14,45,0.88,0.88,,t2-le-45
OVHcloud,V100 (32 GB),Volta,2,64,28,90,1.76,0.88,,t2-le-90
OVHcloud,V100 (32 GB),Volta,4,128,56,180,3.53,0.88,,t2-le-180
OVHcloud,L4 (24 GB),Lovelace,1,24,22,90,1,1,,l4-90
OVHcloud,L4 (24 GB),Lovelace,2,48,45,180,2,1,,l4-180
OVHcloud,L4 (24 GB),Lovelace,4,96,90,360,4,1,,l4-360
OVHcloud,H100 (80 GB),Hopper,1,80,30,380,2.99,2.99,,h100-380
OVHcloud,H100 (80 GB),Hopper,2,160,60,760,5.98,2.99,,h100-760
OVHcloud,H100 (80 GB),Hopper,4,320,120,1520,11.97,2.99,,h100-1520
Oracle Cloud,A10,Ampere,1,24,15,240,2.00,2.00,,VM.GPU.A10.1
Oracle Cloud,A10,Ampere,2,48,30,480,4.00,2.00,,VM.GPU.A10.2
Oracle Cloud,A100 (40 GB),Ampere,8,320,64,2048,24.4,3.05,,BM.GPU.A4.8
Expand Down
2 changes: 1 addition & 1 deletion docs/cloud-gpus/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ not just inference in particular models as a service.

- Direct price comparisons are trickier for serverless offerings: cold boot time and autoscaling logic can substantially impact cost-of-traffic.
- Some of the providers allow configuration of CPU and RAM resources. We have selected reasonable defaults, generally comparable to the fixed offerings of other providers.
- You can find pricing pages for the providers here: [Banana](https://banana.dev#pricing), [Baseten](https://docs.baseten.co/settings/pricing), [Beam](https://beam.cloud/pricing), [Covalent](https://www.covalent.xyz/), [Modal](https://modal.com/pricing), [Replicate](https://replicate.com/pricing), [RunPod](https://www.runpod.io/serverless-gpu)
- You can find pricing pages for the providers here: [Banana](https://banana.dev#pricing), [Baseten](https://docs.baseten.co/settings/pricing), [Beam](https://beam.cloud/pricing), [Covalent](https://www.covalent.xyz/), [Modal](https://modal.com/pricing), [OVHcloud](https://www.ovhcloud.com/en/public-cloud/prices/#11264), [Replicate](https://replicate.com/pricing), [RunPod](https://www.runpod.io/serverless-gpu)
- Serverless GPUs are a newer technology, so the details change quickly and you can expect bugs/growing pains. Stay frosty!
- Raw data can be found in a [csv on GitHub](https://github.com/full-stack-deep-learning/website/blob/main/docs/cloud-gpus/serverless-gpus.csv).

Expand Down
3 changes: 3 additions & 0 deletions docs/cloud-gpus/serverless-gpus.csv
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,9 @@ Modal,A100 (20 GB),Ampere,1,20,4,16,3.07,3.07
Modal,A100 (40 GB),Ampere,1,40,8,40,5.45,5.45
Modal,A100 (40 GB),Ampere,2,40,16,80,10.92,5.45
Modal,A100 (40 GB),Ampere,4,40,32,160,21.83,5.45
OVHcloud,V100 (32 GB),Volta,1,32,13,40,1.01,1.01
OVHcloud,L4 (24 GB),Lovelace,1,24,20,80,0.91,0.91
OVHcloud,H100 (80 GB),Hopper,1,80,28,350,3.39,3.39
Replicate,T4 (16 GB),Turing,1,16,4,8,0.81,0.81
Replicate,A40,Ampere,1,48,4,16,2.07,2.07
Replicate,A40,Ampere,1,48,10,72,2.61,2.61
Expand Down

0 comments on commit 1d4004c

Please sign in to comment.