Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

全局索引回表并发优化, 支持单region多并发 #239

Open
wy1433 opened this issue Apr 19, 2024 · 0 comments
Open

全局索引回表并发优化, 支持单region多并发 #239

wy1433 opened this issue Apr 19, 2024 · 0 comments

Comments

@wy1433
Copy link
Contributor

wy1433 commented Apr 19, 2024

Is your feature request related to a problem? Please describe.
目前走全局索引查询,当单region数据量较大时是有一次prc串行完成,性能不足。分析下来主要有4个环节:

  1. 查全局索引,单region单rpc,并发度不足
  2. 构造主键,回表目前串行,可分批回表,构造主键过程中分批发送
  3. 获取region优化,根据key计算region耗时较高
  4. 主键回表db->store传输数据优化,range结构字段可以精简

Describe the solution you'd like

  • 分批回表,构造主键过程中分批发送, 11W数据全局索引回表耗时减少33%。
  • 获取region优化,11w数据耗时减少11%
  • 主键回表db->store传输数据优化、rocksdb_scan_node优化, 耗时减少8%

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
优化点1尚未解决

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant