genesis.json of 10GB cause 200GB ram usage

[alpha-omega-labs]

Summary

Hello,
We have quite an issue in GenesisL1 with extensive RAM usage during initialization of node from exported genesis.json with state. 10GB file cause up to 200GB RAM utilization
Is there a way to optimize it? There been some works regarding genesis,json streaming, is it implemented opt in sdk v0.46.15?
Thank you!

Problem Definition

No response

Proposed Feature

genesis.json efficient processing

[tac0turtle]

Newer versions of the cosmos sdk will have a reduced foot print. Have you tried using 0.50?

[alpha-omega-labs]

We have ethermint and probably there are no chains working with 0.5 and ethermint.
You think that 10GB genesis.json will work well in v0.5 of sdk, in terms of ram and cpu.
Maybe you know ethermint implementations with v 0.5?
Thank you

[alpha-omega-labs]

Overall this seems to be related: #11601

[alpha-omega-labs]

Newer versions of the cosmos sdk will have a reduced foot print. Have you tried using 0.50?

0.47 has it?

[alpha-omega-labs]

the way genesis.json processed at versions at least < 0.46 of SDK make it unusable for starting new chain with big state (big genesis.json).

[tac0turtle]

closing this as duplicate here #16915