Skip to content
This repository has been archived by the owner on Oct 2, 2020. It is now read-only.

Use cursors instead of loading entire result set into memory #178

Closed
onbjerg opened this issue Apr 6, 2020 · 1 comment
Closed

Use cursors instead of loading entire result set into memory #178

onbjerg opened this issue Apr 6, 2020 · 1 comment
Assignees
@onbjerg
Labels
bug Something isn't working enhancement New feature or request
Milestone
2.1.0

Comments

@onbjerg
Copy link
Contributor

onbjerg commented Apr 6, 2020

Right now we do a single query to get every transaction and log in a block and load this directly into memory. However, some blocks contain very large transactions with a large number of logs, which might cause the worker to run out of memory.

Instead, we should use a cursor and iterate over rows 1-by-1.

Documentation
@onbjerg onbjerg added bug Something isn't working enhancement New feature or request labels Apr 6, 2020
@onbjerg onbjerg added this to the 2.1.0 milestone Apr 6, 2020
@onbjerg onbjerg self-assigned this Apr 6, 2020
@onbjerg
Copy link
Contributor Author

onbjerg commented Jul 28, 2020

No longer relevant since we're moving to The Graph (#200).

@onbjerg onbjerg closed this as completed Jul 28, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@onbjerg onbjerg

Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Milestone
2.1.0
Development

No branches or pull requests
1 participant
@onbjerg