Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: add benchmark for tonbo on s3 #226

Merged
merged 1 commit into from
Nov 19, 2024
Merged

test: add benchmark for tonbo on s3 #226

merged 1 commit into from
Nov 19, 2024

Conversation

KKould
Copy link
Contributor

@KKould KKould commented Nov 18, 2024

No description provided.

@KKould KKould self-assigned this Nov 18, 2024
@KKould KKould linked an issue Nov 18, 2024 that may be closed by this pull request
Copy link

Read:

+--------------------------------------------+---------+---------+----------+
|                                            | tonbo   | rocksdb | tonbo_s3 |
+===========================================================================+
| random range reads                         | 81410ms | 37661ms | 923974ms |
|--------------------------------------------+---------+---------+----------|
| random range reads                         | 78202ms | 37250ms | 918392ms |
|--------------------------------------------+---------+---------+----------|
| random range projection reads              | 38423ms | 37289ms | 290629ms |
|--------------------------------------------+---------+---------+----------|
| random range projection reads              | 38412ms | 37261ms | 291287ms |
|--------------------------------------------+---------+---------+----------|
| random range projection reads (4 threads)  | 32294ms | 37411ms | 108875ms |
|--------------------------------------------+---------+---------+----------|
| random range projection reads (8 threads)  | 30907ms | 37791ms | 77951ms  |
|--------------------------------------------+---------+---------+----------|
| random range projection reads (16 threads) | 27967ms | 35954ms | 57218ms  |
|--------------------------------------------+---------+---------+----------|
| random range projection reads (32 threads) | 23330ms | 36202ms | 46927ms  |
+--------------------------------------------+---------+---------+----------+

Copy link

Write:

+-------------------------------+--------+---------+----------+
|                               | tonbo  | rocksdb | tonbo_s3 |
+=============================================================+
| bulk load                     | 6452ms | 9373ms  | 5998ms   |
|-------------------------------+--------+---------+----------|
| individual writes             | 8317ms | 10518ms | 8273ms   |
|-------------------------------+--------+---------+----------|
| individual writes (4 threads) | 8204ms | 10532ms | 8054ms   |
|-------------------------------+--------+---------+----------|
| individual writes (8 threads) | 7815ms | 10453ms | 7643ms   |
|-------------------------------+--------+---------+----------|
| batch writes                  | 7911ms | 7078ms  | 7973ms   |
|-------------------------------+--------+---------+----------|
| batch writes (4 threads)      | 7512ms | 7117ms  | 7619ms   |
|-------------------------------+--------+---------+----------|
| batch writes (8 threads)      | 7621ms | 7124ms  | 7613ms   |
|-------------------------------+--------+---------+----------|
| removals                      | 3096ms | 3799ms  | 3094ms   |
+-------------------------------+--------+---------+----------+

@ethe ethe merged commit d26bd9f into main Nov 19, 2024
16 checks passed
@ethe ethe deleted the test/bench_s3 branch November 19, 2024 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

refactor: breakdown S3 benchmark action from cache reader
2 participants