Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unexpected System Restart or Halt During Stress Testing #1355

Open
yaksheshgupta opened this issue Oct 2, 2024 · 3 comments
Open

Unexpected System Restart or Halt During Stress Testing #1355

yaksheshgupta opened this issue Oct 2, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@yaksheshgupta
Copy link

We are encountering an unexpected error while performing stress testing on our platform using an Avalanche Subnet. After processing a few hundred transactions, the system either automatically restarts or halts.

For both cases, we receive the following warning:

[09-27|15:54:37.588] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> router/chain_router.go:379 timed out while shutting down {"error": "context deadline exceeded"}

When the chain halts, these are the final logs:

[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:124 stderr collector shutdown
[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:111 stdout collector shutdown

I am giving a some part of log for both cases down below-

  1. automatically restarts itself
[09-27|15:53:21.070] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> proposervm/block.go:271 built block {"blkID": "2hXwWWw8Py3FfRkRhrTgjmFZLAWhFrJRzNm36vGFh7xyuftzpS", "innerBlkID": "EdMQAcK1GMafSA6AttU6jEUeDDAb88fv9HxF2HjKVGqeva4v3", "height": 2850, "pChainHeight": 162860, "parentTimestamp": "[09-27|15:52:58.000]", "blockTimestamp": "[09-27|15:53:10.000]"}
[09-27|15:53:22.271] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> miner/worker.go:531 Commit new mining work                   number=2851 hash=a57e11..fda24b uncles=0 txs=0  gas=0             fees=0               elapsed="402.902µs"
[09-27|15:53:26.459] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/ethapi/api.go:1780 Submitted transaction                    hash=0x747b6c8db7af580f0555d8f5dd10f8d3c3a19485478e0a774f9074031d8c9cba from=0x00EBbc3B3Eb868CcC861e33A75B9fA123816E1Ed nonce=3065 recipient=0xBaA3Ce60C12FC954aa4614fA5A0433f483B5CDf1 value=0                         type=2 gasFeeCap=1,000,010,001 gasTipCap=1,000,010,001 gasPrice=1,000,010,001
[09-27|15:53:38.155] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:437 shutting down consensus engine
[09-27|15:53:38.156] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:111 stdout collector shutdown
[09-27|15:53:38.156] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:124 stderr collector shutdown
[09-27|15:54:37.588] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> router/chain_router.go:379 timed out while shutting down {"error": "context deadline exceeded"}
[09-27|15:54:59.730] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:143 plugin handshake succeeded {"addr": "127.0.0.1:46009"}
[09-27|15:54:59.731] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> rpcchainvm/vm_client.go:171 grpc: serving database {"address": "127.0.0.1:36959"}
[09-27|15:54:59.732] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> rpcchainvm/vm_client.go:190 grpc: serving vm services {"address": "127.0.0.1:45453"}
[09-27|15:54:59.734] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:291 Initializing Subnet EVM VM               Version=v0.6.9 Config="{AirdropFile: SnowmanAPIEnabled:false AdminAPIEnabled:false AdminAPIDir: WarpAPIEnabled:false EnabledEthAPIs:[eth eth-filter net web3 internal-eth internal-blockchain internal-transaction] ContinuousProfilerDir: ContinuousProfilerFrequency:15m0s ContinuousProfilerMaxFiles:5 RPCGasCap:200000000000 RPCTxFeeCap:100 TrieCleanCache:512 TrieDirtyCache:512 TrieDirtyCommitTarget:20 TriePrefetcherParallelism:16 SnapshotCache:256 Preimages:false SnapshotWait:false SnapshotVerify:false Pruning:true AcceptorQueueLimit:64 CommitInterval:4096 AllowMissingTries:false PopulateMissingTries:<nil> PopulateMissingTriesParallelism:1024 PruneWarpDB:false MetricsExpensiveEnabled:true LocalTxsEnabled:false TxPoolPriceLimit:1 TxPoolPriceBump:10 TxPoolAccountSlots:16 TxPoolGlobalSlots:5120 TxPoolAccountQueue:64 TxPoolGlobalQueue:1024 TxPoolLifetime:10m0s APIMaxDuration:0s WSCPURefillRate:0s WSCPUMaxStored:0s MaxBlocksPerRequest:0 AllowUnfinalizedQueries:false AllowUnprotectedTxs:false AllowUnprotectedTxHashes:[0xfefb2da535e927b85fe68eb81cb2e4a5827c905f78381a01ef2322aa9b0aee8e] KeystoreDirectory: KeystoreExternalSigner: KeystoreInsecureUnlockAllowed:false PushGossipPercentStake:0.9 PushGossipNumValidators:100 PushGossipNumPeers:0 PushRegossipNumValidators:10 PushRegossipNumPeers:0 PushGossipFrequency:100ms PullGossipFrequency:1s RegossipFrequency:30s PriorityRegossipAddresses:[] LogLevel:info LogJSONFormat:false FeeRecipient: OfflinePruning:false OfflinePruningBloomFilterSize:512 OfflinePruningDataDirectory: MaxOutboundActiveRequests:16 StateSyncEnabled:false StateSyncSkipResume:false StateSyncServerTrieCache:64 StateSyncIDs: StateSyncCommitInterval:16384 StateSyncMinBlocks:300000 StateSyncRequestSize:1024 InspectDatabase:false SkipUpgradeCheck:false AcceptedCacheSize:32 TransactionHistory:0 TxLookupLimit:0 SkipTxIndexing:false WarpOffChainMessages:[] HttpBodyLimit:0}"
[09-27|15:54:59.735] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:450 Config has not specified any coinbase address. Defaulting to the blackhole address.
[09-27|15:54:59.735] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=contractNativeMinterConfig config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-27|15:54:59.736] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=feeManagerConfig           config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-27|15:54:59.736] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=warpConfig                 config="{\"blockTimestamp\":1725788068,\"quorumNumerator\":67,\"requirePrimaryNetworkSigners\":false}"
[09-27|15:54:59.737] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=17 size=1.81KiB time="179.255µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=0 livesize=0.00B
[09-27|15:54:59.738] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:464 "lastAccepted = 0x1ef0f3387998b3ed994903311909a68e5400aeb3d2ac2269e557db3a129594aa"
[09-27|15:54:59.739] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> eth/backend.go:145 Allocated memory caches                  "trie clean"=512.00MiB "trie dirty"=512.00MiB "snapshot clean"=256.00MiB
[09-27|15:54:59.753] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/rawdb/accessors_trie.go:347 State scheme set to already existing     scheme=hash
[09-27|15:54:59.761] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> eth/backend.go:193 Initialising Ethereum protocol           network=5678 dbversion=8
[09-27|15:54:59.762] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=contractNativeMinterConfig config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-27|15:54:59.763] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=feeManagerConfig           config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-27|15:54:59.763] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=warpConfig                 config="{\"blockTimestamp\":1725788068,\"quorumNumerator\":67,\"requirePrimaryNetworkSigners\":false}"
[09-27|15:54:59.763] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=17 size=1.81KiB time="54.962µs"  gcnodes=0 gcsize=0.00B gctime=0s livenodes=0 livesize=0.00B
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:375 
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:376 ---------------------------------------------------------------------------------------------------------------------------------------------------------
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Chain ID:  5678
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Consensus: Dummy Consensus Engine
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Hard Forks (block based):
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Homestead:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/homestead.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Tangerine Whistle (EIP 150): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/tangerine-whistle.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Spurious Dragon/1 (EIP 155): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Spurious Dragon/2 (EIP 158): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Byzantium:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/byzantium.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Constantinople:              #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/constantinople.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Petersburg:                  #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/petersburg.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Istanbul:                    #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/istanbul.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Muir Glacier:                #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/muir-glacier.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Hard forks (timestamp based):
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Cancun Timestamp:              @253399622400 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/cancun.md)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Verkle Timestamp:              @nil       
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Avalanche Upgrades (timestamp based):
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - SubnetEVM Timestamp:          @0          (https://github.com/ava-labs/avalanchego/releases/tag/v1.10.0)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Durango Timestamp:            @1707840000 (https://github.com/ava-labs/avalanchego/releases/tag/v1.11.0)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Etna Timestamp:           @253399622400 (https://github.com/ava-labs/avalanchego/releases/tag/v1.12.0)
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Precompile Upgrades: {"contractNativeMinterConfig":{"adminAddresses":["0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed"],"blockTimestamp":0},"feeManagerConfig":{"adminAddresses":["0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed"],"blockTimestamp":0},"warpConfig":{"blockTimestamp":1725788068,"quorumNumerator":67,"requirePrimaryNetworkSigners":false}}
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Upgrade Config: {}
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Fee Config: {"gasLimit":100000000000,"targetBlockRate":3,"minBaseFee":10000,"targetGas":160000000000,"baseFeeChangeDenominator":10000,"minBlockGasCost":0,"maxBlockGasCost":160000000000,"blockGasCostStep":10000}
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Allow Fee Recipients: false
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:380 ---------------------------------------------------------------------------------------------------------------------------------------------------------
[09-27|15:54:59.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:381 
[09-27|15:54:59.792] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:714 Loaded most recent local header          number=2850 hash=1ef0f3..9594aa age=1m49s
[09-27|15:54:59.792] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:715 Loaded most recent local full block      number=2850 hash=1ef0f3..9594aa age=1m49s
[09-27|15:54:59.793] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1802 Loaded Acceptor tip                      hash=1ef0f3..9594aa
[09-27|15:54:59.930] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1862 Re-executing blocks to generate state for last accepted block from=2821 to=2850
[09-27|15:54:59.930] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2821 target=2850 remaining=30 elapsed="40.766µs"
[09-27|15:55:29.666] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2822 target=2850 remaining=29 elapsed=29.735856189s
[09-27|15:55:53.856] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2823 target=2850 remaining=28 elapsed=53.926493289s
[09-27|15:56:15.051] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2824 target=2850 remaining=27 elapsed=1m15.121472974s
[09-27|15:56:32.184] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2825 target=2850 remaining=26 elapsed=1m32.25427576s
[09-27|15:56:50.854] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2826 target=2850 remaining=25 elapsed=1m50.924104399s
[09-27|15:57:06.307] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2827 target=2850 remaining=24 elapsed=2m6.376941669s
[09-27|15:57:21.553] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2828 target=2850 remaining=23 elapsed=2m21.623096868s
[09-27|15:57:36.282] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2829 target=2850 remaining=22 elapsed=2m36.351801839s
[09-27|15:57:50.328] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2830 target=2850 remaining=21 elapsed=2m50.39830549s
[09-27|15:58:05.300] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2831 target=2850 remaining=20 elapsed=3m5.369729707s
[09-27|15:58:19.732] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2832 target=2850 remaining=19 elapsed=3m19.801842734s
[09-27|15:58:33.046] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2833 target=2850 remaining=18 elapsed=3m33.116291432s
[09-27|15:58:46.532] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2834 target=2850 remaining=17 elapsed=3m46.602446245s
[09-27|15:58:59.708] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2835 target=2850 remaining=16 elapsed=3m59.77804814s
[09-27|15:59:12.587] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2836 target=2850 remaining=15 elapsed=4m12.65667562s
[09-27|15:59:25.393] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2837 target=2850 remaining=14 elapsed=4m25.463416489s
[09-27|15:59:38.194] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2838 target=2850 remaining=13 elapsed=4m38.263985375s
[09-27|15:59:50.476] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2839 target=2850 remaining=12 elapsed=4m50.545985566s
[09-27|16:00:02.917] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2840 target=2850 remaining=11 elapsed=5m2.986680776s
[09-27|16:00:14.799] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2841 target=2850 remaining=10 elapsed=5m14.869062458s
[09-27|16:00:26.699] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2842 target=2850 remaining=9  elapsed=5m26.769253291s
[09-27|16:00:39.484] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2843 target=2850 remaining=8  elapsed=5m39.553946735s
[09-27|16:00:51.741] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2844 target=2850 remaining=7  elapsed=5m51.81100145s
[09-27|16:01:04.396] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2845 target=2850 remaining=6  elapsed=6m4.465984475s
[09-27|16:01:16.287] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2846 target=2850 remaining=5  elapsed=6m16.357004151s
[09-27|16:01:28.689] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2847 target=2850 remaining=4  elapsed=6m28.759395288s
[09-27|16:01:40.224] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2848 target=2850 remaining=3  elapsed=6m40.293851849s
[09-27|16:01:51.786] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2849 target=2850 remaining=2  elapsed=6m51.856429105s
[09-27|16:02:03.683] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=2850 target=2850 remaining=1  elapsed=7m3.753060702s
[09-27|16:02:15.848] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1921 Historical state regenerated             block=2850 elapsed=7m15.917573957s nodes=297.74MiB preimages=0.00B
[09-27|16:02:32.911] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=943,954   size=204.12MiB time=17.063743854s gcnodes=347,416 gcsize=182.23MiB gctime=1.546832578s livenodes=0 livesize=0.00B
[09-27|16:02:32.914] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1778 Initializing snapshots                   async=true rebuild=true headHash=1ef0f3..9594aa headRoot=f93ebf..754879
[09-27|16:02:32.993] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:562 Warmed accepted caches                   start=2819 end=2850 t=74.394839ms
[09-27|16:02:32.993] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:568 Starting Acceptor                        "queue length"=64
[09-27|16:02:33.010] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/shutdowncheck/shutdown_tracker.go:67 Unclean shutdown detected                booted=2024-09-27T15:51:56+0000 age=10m37s
[09-27|16:02:33.010] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/txpool/legacypool/legacypool.go:486 Legacy pool tip threshold updated        tip=0
[09-27|16:02:33.019] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> proposervm/vm.go:205 initialized proposervm {"state": "after fork", "forkHeight": 1, "lastAcceptedHeight": 2850}
[09-27|16:02:33.019] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:93 initializing consensus engine
[09-27|16:02:33.020] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:1034 Enabled APIs: eth, eth-filter, net, web3, internal-eth, internal-blockchain, internal-transaction
[09-27|16:02:33.029] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/bootstrapper.go:170 starting bootstrapper {"lastAcceptedID": "2hXwWWw8Py3FfRkRhrTgjmFZLAWhFrJRzNm36vGFh7xyuftzpS", "lastAcceptedHeight": 2850}
[09-27|16:02:33.030] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/bootstrapper.go:375 starting to fetch blocks {"numKnownBlocks": 0, "numAcceptedBlocks": 1, "numMissingBlocks": 1}
[09-27|16:02:33.030] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/storage.go:195 executing blocks {"numToExecute": 0}
[09-27|16:02:33.030] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/storage.go:187 executed blocks {"numExecuted": 0, "numToExecute": 0, "halted": false, "duration": "31.649µs"}
[09-27|16:02:33.032] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:513 starting consensus {"lastAcceptedID": "2hXwWWw8Py3FfRkRhrTgjmFZLAWhFrJRzNm36vGFh7xyuftzpS", "lastAcceptedHeight": 2850}
  1. Just halts
[09-27|19:03:32.687] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/ethapi/api.go:1780 Submitted transaction                    hash=0x4b1754ddf4c3a2b3573c33fec6387dbbf6b999e356cd563db3356db68296fba7 from=0x00EBbc3B3Eb868CcC861e33A75B9fA123816E1Ed nonce=3269 recipient=0xBaA3Ce60C12FC954aa4614fA5A0433f483B5CDf1 value=0 type=2 gasFeeCap=1,000,010,001 gasTipCap=1,000,010,001 gasPrice=1,000,010,001
[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:124 stderr collector shutdown
[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:111 stdout collector shutdown
azureuser@<vm-name>-bc:~/.avalanchego/logs$ sudo systemctl status avalanchego
● avalanchego.service - AvalancheGo systemd service
     Loaded: loaded (/etc/systemd/system/avalanchego.service; enabled; preset: enabled)
     Active: active (running) since Fri 2024-09-27 15:54:49 UTC; 2 days ago
   Main PID: 144844 (avalanchego)
      Tasks: 29 (limit: 19118)
     Memory: 5.1G (peak: 14.8G)
        CPU: 6h 39min 44.118s
     CGroup: /system.slice/avalanchego.service
             └─144844 /home/azureuser/avalanche-node/avalanchego --config-file=/home/azureuser/.avalanchego/configs/node.json
Sep 30 06:26:30 <vm-name>-bc avalanchego[144844]: [09-30|06:26:30.110] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,080,187 hash=9bab>
Sep 30 06:31:32 <vm-name>-bc avalanchego[144844]: [09-30|06:31:32.849] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,080,222 hash=7d62>
Sep 30 06:49:26 <vm-name>-bc avalanchego[144844]: [09-30|06:49:26.362] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,080,377 hash=90cb>
Sep 30 08:09:47 <vm-name>-bc avalanchego[144844]: [09-30|08:09:47.748] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,081,334 hash=4e7d>
Sep 30 08:39:38 <vm-name>-bc avalanchego[144844]: [09-30|08:39:38.050] INFO <C Chain> plugin/evm/atomic_trie.go:219 committed atomic trie                    root=0x2c64aa9cc707a7>
Sep 30 08:39:38 <vm-name>-bc avalanchego[144844]: [09-30|08:39:38.194] INFO <C Chain> trie/triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=18973 size>
Sep 30 09:15:44 <vm-name>-bc avalanchego[144844]: [09-30|09:15:44.617] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,082,043 hash=4131>
Sep 30 09:29:08 <vm-name>-bc avalanchego[144844]: [09-30|09:29:08.435] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,082,235 hash=42fc>
Sep 30 10:56:38 <vm-name>-bc avalanchego[144844]: [09-30|10:56:38.345] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,083,373 hash=8f98>
Sep 30 11:02:26 <vm-name>-bc avalanchego[144844]: [09-30|11:02:26.103] INFO <C Chain> core/blockchain.go:1580 Resetting chain preference               number=36,083,487 hash=1f2f>
azureuser@<vm-name>-bc:~/.avalanchego/logs$ tail P.log 
[09-27|15:54:53.373] INFO <P Chain> proposervm/vm.go:205 initialized proposervm {"state": "after fork", "forkHeight": 47529, "lastAcceptedHeight": 162876}
[09-27|15:54:53.374] INFO <P Chain> snowman/engine.go:93 initializing consensus engine
[09-27|15:54:53.374] INFO <P Chain> bootstrap/bootstrapper.go:170 starting bootstrapper {"lastAcceptedID": "2ZYGbZHH6xyt2aPWPjUwZqCZnXLWPw83T1ChP7nEXmzPzqKhm6", "lastAcceptedHeight": 162876}
[09-27|15:54:59.478] INFO <P Chain> bootstrap/bootstrapper.go:375 starting to fetch blocks {"numKnownBlocks": 99, "numAcceptedBlocks": 1, "numMissingBlocks": 100}
[09-27|15:54:59.603] INFO <P Chain> bootstrap/storage.go:195 executing blocks {"numToExecute": 0}
[09-27|15:54:59.603] INFO <P Chain> bootstrap/storage.go:187 executed blocks {"numExecuted": 0, "numToExecute": 0, "halted": false, "duration": "175.929µs"}
[09-27|15:54:59.603] INFO <P Chain> bootstrap/bootstrapper.go:702 waiting for the remaining chains in this subnet to finish syncing
[09-27|15:56:45.676] INFO <P Chain> snowman/engine.go:513 starting consensus {"lastAcceptedID": "2ZYGbZHH6xyt2aPWPjUwZqCZnXLWPw83T1ChP7nEXmzPzqKhm6", "lastAcceptedHeight": 162876}
[09-27|15:56:45.677] INFO <P Chain> validators/logger.go:50 node added to validator set {"subnetID": "11111111111111111111111111111111LpoYY", "nodeID": "NodeID-ArB1CWwdzhbiZQteF37iqFX4rokdJdDvo", "publicKey": "0xa3cda572bc602ca6a2d7899a2ac4fb42473c71e7de5db54e29b9092ed791f6a6c68f765ae884affe899fb1c76a354e92", "txID": "XxD49J5E4Jk5neWMVdX1F72CXB2iFFeuKsSNdKKz4CqK5AYtu", "weight": 1000000000}
[09-27|15:56:45.677] INFO <P Chain> validators/logger.go:50 node added to validator set {"subnetID": "2Vx4WyApDwTHnJJSmQWFEDK6EgiVm6cf4W4HC8rzsKzUJaGFLX", "nodeID": "NodeID-ArB1CWwdzhbiZQteF37iqFX4rokdJdDvo", "publicKey": null, "txID": "2MdAzsYyz9fBiE8T9m4599xM1Y9JDYHBHx4DdLR4nDw1fjGDNs", "weight": 30}
azureuser@<vm-name>-bc:~/.avalanchego/logs$ tail X.log 
[09-27|15:54:59.639] INFO <X Chain> queue/jobs.go:223 executed operations {"numExecuted": 0}
[09-27|15:54:59.639] INFO <X Chain> bootstrap/bootstrapper.go:613 executing vertices
[09-27|15:54:59.639] INFO <X Chain> queue/jobs.go:223 executed operations {"numExecuted": 0}
[09-27|15:54:59.644] INFO <X Chain> proposervm/vm.go:205 initialized proposervm {"state": "after fork", "forkHeight": 1, "lastAcceptedHeight": 28547}
[09-27|15:54:59.644] INFO <X Chain> bootstrap/bootstrapper.go:170 starting bootstrapper {"lastAcceptedID": "2DY5zyMs22Xb2D5T6TKAxm9RKgDcuonADEcAt3KYM3ioWsYi2p", "lastAcceptedHeight": 28547}
[09-27|15:55:19.871] INFO <X Chain> bootstrap/bootstrapper.go:375 starting to fetch blocks {"numKnownBlocks": 99, "numAcceptedBlocks": 1, "numMissingBlocks": 100}
[09-27|15:55:19.940] INFO <X Chain> bootstrap/storage.go:195 executing blocks {"numToExecute": 0}
[09-27|15:55:19.941] INFO <X Chain> bootstrap/storage.go:187 executed blocks {"numExecuted": 0, "numToExecute": 0, "halted": false, "duration": "110.166µs"}
[09-27|15:55:19.941] INFO <X Chain> bootstrap/bootstrapper.go:702 waiting for the remaining chains in this subnet to finish syncing
[09-27|15:57:02.438] INFO <X Chain> snowman/engine.go:513 starting consensus {"lastAcceptedID": "2DY5zyMs22Xb2D5T6TKAxm9RKgDcuonADEcAt3KYM3ioWsYi2p", "lastAcceptedHeight": 28547}
azureuser@<vm-name>-bc:~/.avalanchego/logs$ sudo systemctl restart avalanchego
azureuser@<vm-name>-bc:~/.avalanchego/logs$ tail -f 2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ.log 
[09-27|19:03:15.425] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> miner/worker.go:531 Commit new mining work                   number=3054 hash=28dbd2..626eda uncles=0 txs=0 gas=0           fees=0               elapsed="770.644µs"
[09-27|19:03:16.448] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/ethapi/api.go:1780 Submitted transaction                    hash=0x7d2082a45392ce45e2f5e476fd68f2f86e53b161123ce1f4932a87f3fe355503 from=0x00EBbc3B3Eb868CcC861e33A75B9fA123816E1Ed nonce=3268 recipient=0xBaA3Ce60C12FC954aa4614fA5A0433f483B5CDf1 value=0 type=2 gasFeeCap=1,000,010,001 gasTipCap=1,000,010,001 gasPrice=1,000,010,001
[09-27|19:03:26.989] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> miner/worker.go:531 Commit new mining work                   number=3054 hash=8f7731..747b30 uncles=0 txs=1 gas=213,257,993 fees=0.2132601258    elapsed=10.540s
[09-27|19:03:27.283] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> proposervm/block.go:271 built block {"blkID": "23pxSodCFEiW8gPrkKUToDMtzRUu1Vu4wic6ppRSan9bZ4GTYF", "innerBlkID": "26Bdu9MxJVnpJrG3mvZrCR7kqXfSzi8VPzBgeSMTDCNFC17XZT", "height": 3054, "pChainHeight": 162890, "parentTimestamp": "[09-27|19:03:08.000]", "blockTimestamp": "[09-27|19:03:16.000]"}
[09-27|19:03:28.643] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> miner/worker.go:531 Commit new mining work                   number=3055 hash=9726a3..029997 uncles=0 txs=0 gas=0           fees=0               elapsed="811.033µs"
[09-27|19:03:32.687] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/ethapi/api.go:1780 Submitted transaction                    hash=0x4b1754ddf4c3a2b3573c33fec6387dbbf6b999e356cd563db3356db68296fba7 from=0x00EBbc3B3Eb868CcC861e33A75B9fA123816E1Ed nonce=3269 recipient=0xBaA3Ce60C12FC954aa4614fA5A0433f483B5CDf1 value=0 type=2 gasFeeCap=1,000,010,001 gasTipCap=1,000,010,001 gasPrice=1,000,010,001
[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:124 stderr collector shutdown
[09-27|19:03:53.456] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:111 stdout collector shutdown
[09-30|13:14:21.939] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:437 shutting down consensus engine
[09-30|13:15:21.939] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> router/chain_router.go:379 timed out while shutting down {"error": "context deadline exceeded"}
[09-30|13:15:31.048] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> subprocess/runtime.go:143 plugin handshake succeeded {"addr": "127.0.0.1:36289"}
[09-30|13:15:31.053] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> rpcchainvm/vm_client.go:171 grpc: serving database {"address": "127.0.0.1:45677"}
[09-30|13:15:31.054] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> rpcchainvm/vm_client.go:190 grpc: serving vm services {"address": "127.0.0.1:33817"}
[09-30|13:15:31.056] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:291 Initializing Subnet EVM VM               Version=v0.6.9 Config="{AirdropFile: SnowmanAPIEnabled:false AdminAPIEnabled:false AdminAPIDir: WarpAPIEnabled:false EnabledEthAPIs:[eth eth-filter net web3 internal-eth internal-blockchain internal-transaction] ContinuousProfilerDir: ContinuousProfilerFrequency:15m0s ContinuousProfilerMaxFiles:5 RPCGasCap:200000000000 RPCTxFeeCap:100 TrieCleanCache:512 TrieDirtyCache:512 TrieDirtyCommitTarget:20 TriePrefetcherParallelism:16 SnapshotCache:256 Preimages:false SnapshotWait:false SnapshotVerify:false Pruning:true AcceptorQueueLimit:64 CommitInterval:4096 AllowMissingTries:false PopulateMissingTries:<nil> PopulateMissingTriesParallelism:1024 PruneWarpDB:false MetricsExpensiveEnabled:true LocalTxsEnabled:false TxPoolPriceLimit:1 TxPoolPriceBump:10 TxPoolAccountSlots:16 TxPoolGlobalSlots:5120 TxPoolAccountQueue:64 TxPoolGlobalQueue:1024 TxPoolLifetime:10m0s APIMaxDuration:0s WSCPURefillRate:0s WSCPUMaxStored:0s MaxBlocksPerRequest:0 AllowUnfinalizedQueries:false AllowUnprotectedTxs:false AllowUnprotectedTxHashes:[0xfefb2da535e927b85fe68eb81cb2e4a5827c905f78381a01ef2322aa9b0aee8e] KeystoreDirectory: KeystoreExternalSigner: KeystoreInsecureUnlockAllowed:false PushGossipPercentStake:0.9 PushGossipNumValidators:100 PushGossipNumPeers:0 PushRegossipNumValidators:10 PushRegossipNumPeers:0 PushGossipFrequency:100ms PullGossipFrequency:1s RegossipFrequency:30s PriorityRegossipAddresses:[] LogLevel:info LogJSONFormat:false FeeRecipient: OfflinePruning:false OfflinePruningBloomFilterSize:512 OfflinePruningDataDirectory: MaxOutboundActiveRequests:16 StateSyncEnabled:false StateSyncSkipResume:false StateSyncServerTrieCache:64 StateSyncIDs: StateSyncCommitInterval:16384 StateSyncMinBlocks:300000 StateSyncRequestSize:1024 InspectDatabase:false SkipUpgradeCheck:false AcceptedCacheSize:32 TransactionHistory:0 TxLookupLimit:0 SkipTxIndexing:false WarpOffChainMessages:[] HttpBodyLimit:0}"
[09-30|13:15:31.057] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:450 Config has not specified any coinbase address. Defaulting to the blackhole address.
[09-30|13:15:31.057] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=contractNativeMinterConfig config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-30|13:15:31.058] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=feeManagerConfig           config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-30|13:15:31.058] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=warpConfig                 config="{\"blockTimestamp\":1725788068,\"quorumNumerator\":67,\"requirePrimaryNetworkSigners\":false}"
[09-30|13:15:31.060] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=17 size=1.81KiB time="973.698µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=0 livesize=0.00B
[09-30|13:15:31.063] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:464 "lastAccepted = 0x8f773188df173116ffb0957a93308215b7d3f6e8cb4315cc2eebceb9cc747b30"
[09-30|13:15:31.064] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> eth/backend.go:145 Allocated memory caches                  "trie clean"=512.00MiB "trie dirty"=512.00MiB "snapshot clean"=256.00MiB
[09-30|13:15:31.093] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/rawdb/accessors_trie.go:347 State scheme set to already existing     scheme=hash
[09-30|13:15:31.102] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> eth/backend.go:193 Initialising Ethereum protocol           network=5678 dbversion=8
[09-30|13:15:31.103] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=contractNativeMinterConfig config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-30|13:15:31.103] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=feeManagerConfig           config="{\"adminAddresses\":[\"0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed\"],\"blockTimestamp\":0}"
[09-30|13:15:31.104] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state_processor.go:238 Activating new precompile                name=warpConfig                 config="{\"blockTimestamp\":1725788068,\"quorumNumerator\":67,\"requirePrimaryNetworkSigners\":false}"
[09-30|13:15:31.104] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=17 size=1.81KiB time="22.341µs"  gcnodes=0 gcsize=0.00B gctime=0s livenodes=0 livesize=0.00B
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:375 
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:376 ---------------------------------------------------------------------------------------------------------------------------------------------------------
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Chain ID:  5678
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Consensus: Dummy Consensus Engine
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Hard Forks (block based):
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Homestead:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/homestead.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Tangerine Whistle (EIP 150): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/tangerine-whistle.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Spurious Dragon/1 (EIP 155): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Spurious Dragon/2 (EIP 158): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Byzantium:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/byzantium.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Constantinople:              #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/constantinople.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Petersburg:                  #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/petersburg.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Istanbul:                    #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/istanbul.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Muir Glacier:                #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/muir-glacier.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Hard forks (timestamp based):
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Cancun Timestamp:              @253399622400 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/cancun.md)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Verkle Timestamp:              @nil       
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Avalanche Upgrades (timestamp based):
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - SubnetEVM Timestamp:          @0          (https://github.com/ava-labs/avalanchego/releases/tag/v1.10.0)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Durango Timestamp:            @1707840000 (https://github.com/ava-labs/avalanchego/releases/tag/v1.11.0)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378  - Etna Timestamp:           @253399622400 (https://github.com/ava-labs/avalanchego/releases/tag/v1.12.0)
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Precompile Upgrades: {"contractNativeMinterConfig":{"adminAddresses":["0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed"],"blockTimestamp":0},"feeManagerConfig":{"adminAddresses":["0x00ebbc3b3eb868ccc861e33a75b9fa123816e1ed"],"blockTimestamp":0},"warpConfig":{"blockTimestamp":1725788068,"quorumNumerator":67,"requirePrimaryNetworkSigners":false}}
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Upgrade Config: {}
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Fee Config: {"gasLimit":100000000000,"targetBlockRate":3,"minBaseFee":10000,"targetGas":160000000000,"baseFeeChangeDenominator":10000,"minBlockGasCost":0,"maxBlockGasCost":160000000000,"blockGasCostStep":10000}
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 Allow Fee Recipients: false
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:378 
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:380 ---------------------------------------------------------------------------------------------------------------------------------------------------------
[09-30|13:15:31.117] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:381 
[09-30|13:15:31.125] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:714 Loaded most recent local header          number=3054 hash=8f7731..747b30 age=2d18h12m
[09-30|13:15:31.125] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:715 Loaded most recent local full block      number=3054 hash=8f7731..747b30 age=2d18h12m
[09-30|13:15:31.126] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1802 Loaded Acceptor tip                      hash=8f7731..747b30
[09-30|13:15:31.306] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1862 Re-executing blocks to generate state for last accepted block from=3025 to=3054
[09-30|13:15:31.306] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3025 target=3054 remaining=30 elapsed="31.138µs"
[09-30|13:16:05.349] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3026 target=3054 remaining=29 elapsed=34.042705961s
[09-30|13:16:30.337] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3027 target=3054 remaining=28 elapsed=59.030700554s
[09-30|13:16:47.882] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3028 target=3054 remaining=27 elapsed=1m16.576242153s
[09-30|13:17:08.166] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3029 target=3054 remaining=26 elapsed=1m36.859591603s
[09-30|13:17:27.669] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3030 target=3054 remaining=25 elapsed=1m56.363039459s
[09-30|13:17:43.206] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3031 target=3054 remaining=24 elapsed=2m11.900085979s
[09-30|13:17:57.617] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3032 target=3054 remaining=23 elapsed=2m26.31057742s
[09-30|13:18:12.503] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3033 target=3054 remaining=22 elapsed=2m41.196880026s
[09-30|13:18:26.760] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3034 target=3054 remaining=21 elapsed=2m55.453667248s
[09-30|13:18:40.309] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3035 target=3054 remaining=20 elapsed=3m9.002712997s
[09-30|13:18:53.853] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3036 target=3054 remaining=19 elapsed=3m22.546967118s
[09-30|13:19:07.859] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3037 target=3054 remaining=18 elapsed=3m36.552819813s
[09-30|13:19:22.121] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3038 target=3054 remaining=17 elapsed=3m50.815074213s
[09-30|13:19:35.707] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3039 target=3054 remaining=16 elapsed=4m4.400947926s
[09-30|13:19:49.555] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3040 target=3054 remaining=15 elapsed=4m18.248790597s
[09-30|13:20:02.988] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3041 target=3054 remaining=14 elapsed=4m31.681907518s
[09-30|13:20:15.549] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3042 target=3054 remaining=13 elapsed=4m44.24233337s
[09-30|13:20:27.957] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3043 target=3054 remaining=12 elapsed=4m56.650441111s
[09-30|13:20:39.863] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3044 target=3054 remaining=11 elapsed=5m8.557198305s
[09-30|13:20:54.093] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3045 target=3054 remaining=10 elapsed=5m22.787271665s
[09-30|13:21:07.457] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3046 target=3054 remaining=9  elapsed=5m36.15047039s
[09-30|13:21:18.940] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3047 target=3054 remaining=8  elapsed=5m47.633484948s
[09-30|13:21:31.113] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3048 target=3054 remaining=7  elapsed=5m59.807239921s
[09-30|13:21:43.625] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3049 target=3054 remaining=6  elapsed=6m12.318588888s
[09-30|13:21:55.783] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3050 target=3054 remaining=5  elapsed=6m24.476988843s
[09-30|13:22:07.864] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3051 target=3054 remaining=4  elapsed=6m36.558164938s
[09-30|13:22:19.640] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3052 target=3054 remaining=3  elapsed=6m48.333479706s
[09-30|13:22:31.297] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3053 target=3054 remaining=2  elapsed=6m59.990552367s
[09-30|13:22:42.637] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1868 Regenerating historical state            block=3054 target=3054 remaining=1  elapsed=7m11.330723833s
[09-30|13:22:54.188] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1921 Historical state regenerated             block=3054 elapsed=7m22.882308424s nodes=300.13MiB preimages=0.00B
[09-30|13:23:10.488] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> triedb/hashdb/database.go:542 Persisted trie from memory database      nodes=943,129   size=206.59MiB time=16.29965977s gcnodes=344,146 gcsize=180.92MiB gctime=1.532206966s livenodes=0 livesize=0.00B
[09-30|13:23:10.490] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:1778 Initializing snapshots                   async=true rebuild=true headHash=8f7731..747b30 headRoot=f35596..c90a02
[09-30|13:23:10.607] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:562 Warmed accepted caches                   start=3023 end=3054 t=114.917914ms
[09-30|13:23:10.607] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/blockchain.go:568 Starting Acceptor                        "queue length"=64
[09-30|13:23:10.644] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/shutdowncheck/shutdown_tracker.go:67 Unclean shutdown detected                booted=2024-09-27T15:51:56+0000 age=2d21h31m
[09-30|13:23:10.644] WARN <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> internal/shutdowncheck/shutdown_tracker.go:67 Unclean shutdown detected                booted=2024-09-27T19:02:33+0000 age=2d18h20m
[09-30|13:23:10.644] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/txpool/legacypool/legacypool.go:486 Legacy pool tip threshold updated        tip=0
[09-30|13:23:10.653] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> proposervm/vm.go:205 initialized proposervm {"state": "after fork", "forkHeight": 1, "lastAcceptedHeight": 3054}
[09-30|13:23:10.653] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:93 initializing consensus engine
[09-30|13:23:10.654] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> plugin/evm/vm.go:1034 Enabled APIs: eth, eth-filter, net, web3, internal-eth, internal-blockchain, internal-transaction
[09-30|13:23:10.660] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/bootstrapper.go:170 starting bootstrapper {"lastAcceptedID": "23pxSodCFEiW8gPrkKUToDMtzRUu1Vu4wic6ppRSan9bZ4GTYF", "lastAcceptedHeight": 3054}
[09-30|13:23:10.661] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/bootstrapper.go:375 starting to fetch blocks {"numKnownBlocks": 0, "numAcceptedBlocks": 1, "numMissingBlocks": 1}
[09-30|13:23:10.662] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/storage.go:195 executing blocks {"numToExecute": 0}
[09-30|13:23:10.662] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> bootstrap/storage.go:187 executed blocks {"numExecuted": 0, "numToExecute": 0, "halted": false, "duration": "72.896µs"}
[09-30|13:23:10.665] INFO <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> snowman/engine.go:513 starting consensus {"lastAcceptedID": "23pxSodCFEiW8gPrkKUToDMtzRUu1Vu4wic6ppRSan9bZ4GTYF", "lastAcceptedHeight": 3054}
^C
azureuser@<vm-name>-bc:~/.avalanchego/logs$
@yaksheshgupta yaksheshgupta added the bug Something isn't working label Oct 2, 2024
@darioush
Copy link
Collaborator

darioush commented Oct 2, 2024

Could you please submit the full log directory, if they don't contain any private information?

@darioush
Copy link
Collaborator

darioush commented Oct 2, 2024

Additionally, could you check the OS logs for any processes killed for OOM?

@yaksheshgupta
Copy link
Author

@darioush
sure, i ll attach the logs in the following comments.
also i checked sys logs for OOM, i suspect this might be an issue. I gave 100GB of swap memory to the process but got another error.

[10-05|17:29:05.274] ERROR <2BCr6t4MjEACbFCU8bKYepmX262RA7tE4dwr6sJgV2wYMCZDtJ Chain> core/state/trie_prefetcher.go:563 Trie prefetcher failed fetching          root=e6680a..79596c err="missing trie node 0c402567974784136c306ca22236580671451fd717affd8e6b3013c4c3c9763c (owner 93e0df4f4557f005a009c15c694a6245035e9933cc9e2f20e295e5af5eb3ab27) (path 02030e000e) <nil>"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@darioush @yaksheshgupta and others