pebble: batch too large

[rayn316]

Describe the bug
Node startup failed

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: [e.g. iOS]
• Browser [e.g. chrome, safari]
• Version [e.g. 22]

Smartphone (please complete the following information):

• Device: [e.g. iPhone6]
• OS: [e.g. iOS8.1]
• Browser [e.g. stock browser, safari]
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

Mar 12 15:29:46 ftm-opera[1700935]: INFO [03-12|15:29:46.194] Maximum peer count                       total=200
Mar 12 15:29:46 ftm-opera[1700935]: INFO [03-12|15:29:46.194] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
Mar 12 15:29:48 ftm-opera[1700935]: INFO [03-12|15:29:48.042] Genesis is already written               name=main id=250 genesis=0x4a53c5445584b3bfc20dbfb2ec18ae20037c716f3ba2d9e1da768a9deca17cb4
Mar 12 15:29:48 ftm-opera[1700935]: INFO [03-12|15:29:48.047] Loaded local transaction journal         transactions=0 dropped=0
Mar 12 15:29:48 ftm-opera[1700935]: INFO [03-12|15:29:48.047] Regenerated local transaction journal    transactions=0 accounts=0
Mar 12 15:29:48 ftm-opera[1700935]: INFO [03-12|15:29:48.517] Starting peer-to-peer node               instance=go-opera/v1.1.3-rc.5-ace95a8a-1697285461/linux-amd64/go1.20.9
Mar 12 15:30:05 ftm-opera[1700935]: INFO [03-12|15:30:05.885] New local node record                    seq=217 id=ccc2af968684abc8 ip=127.0.0.1 udp=31400 tcp=31400
Mar 12 15:30:05 ftm-opera[1700935]: INFO [03-12|15:30:05.890] Started P2P networking                   self=enode://a35819c8e71b20dbff4151d8d019910a0862e2a23fe2bc0b3428038e07d6370299dbc08018e3834072493141068e6a4dbc25d3559aba06c72adb32ce130eb4a6@127.0.0.1:31400
Mar 12 15:30:05 ftm-opera[1700935]: INFO [03-12|15:30:05.891] IPC endpoint opened                      url=/node/full/fantom/opera.ipc
Mar 12 15:30:05 ftm-opera[1700935]: ERROR[03-12|15:30:05.891] Unavailable modules in HTTP API list     unavailable=[trace] available="[admin debug web3 eth dag txpool personal abft ftm net]"
Mar 12 15:30:05 ftm-opera[1700935]: ERROR[03-12|15:30:05.891] Unavailable modules in HTTP API list     unavailable=[trace] available="[admin debug web3 eth dag txpool personal abft ftm net]"
Mar 12 15:30:05 ftm-opera[1700935]: INFO [03-12|15:30:05.892] HTTP server started                      endpoint=127.0.0.1:31401 prefix= cors=* vhosts=*
Mar 12 15:30:05 ftm-opera[1700935]: INFO [03-12|15:30:05.892] WebSocket enabled                        url=ws://127.0.0.1:31402
Mar 12 15:30:07 ftm-opera[1700935]: INFO [03-12|15:30:07.930] New local node record                    seq=218 id=ccc2af968684abc8 ip=173.231.40.194 udp=31400 tcp=31400
Mar 12 15:30:19 ftm-opera[1700935]: INFO [03-12|15:30:19.816] Rebuilding state snapshot
Mar 12 15:30:19 ftm-opera[1700935]: INFO [03-12|15:30:19.816] EVM snapshot                             module=gossip-store at=000000..000000 generating=true
Mar 12 15:30:19 ftm-opera[1700935]: INFO [03-12|15:30:19.816] Resuming state snapshot generation       accounts=0 slots=0 storage=0.00B elapsed="305.067µs"
Mar 12 15:32:02 ftm-opera[1700935]: INFO [03-12|15:32:02.139] New LLR summary                          last_epoch=270209 last_block=0 new_evs=1 new_ers=0 new_bvs=0 new_brs=0 age=none
Mar 12 15:38:00 ftm-opera[1700935]: INFO [03-12|15:38:00.519] New LLR summary                          last_epoch=270210 last_block=0 new_evs=5 new_ers=1 new_bvs=0 new_brs=0 age=10m19.514s
Mar 12 15:48:34 ftm-opera[1700935]: INFO [03-12|15:48:34.126] New LLR summary                          last_epoch=270211 last_block=0 new_evs=5 new_ers=1 new_bvs=0 new_brs=0 age=10m51.924s
Mar 12 15:59:09 ftm-opera[1700935]: INFO [03-12|15:59:09.514] New LLR summary                          last_epoch=270212 last_block=0 new_evs=7 new_ers=1 new_bvs=0 new_brs=0 age=10m46.714s
Mar 12 16:03:48 ftm-opera[1700935]: panic: pebble: batch too large: >= 4.0 G
Mar 12 16:03:48 ftm-opera[1700935]: goroutine 4847 [running]:
Mar 12 16:03:48 ftm-opera[1700935]: github.com/cockroachdb/pebble.(*Batch).grow(0x7b8040?, 0x0?)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/cockroachdb/pebble@v0.0.0-20221111210721-1bda21f14fc2/batch.go:1129 +0x129
Mar 12 16:03:48 ftm-opera[1700935]: github.com/cockroachdb/pebble.(*Batch).prepareDeferredKeyRecord(0xc013ded440, 0x21, 0x0)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/cockroachdb/pebble@v0.0.0-20221111210721-1bda21f14fc2/batch.go:498 +0x74
Mar 12 16:03:48 ftm-opera[1700935]: github.com/cockroachdb/pebble.(*Batch).DeleteDeferred(...)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/cockroachdb/pebble@v0.0.0-20221111210721-1bda21f14fc2/batch.go:600
Mar 12 16:03:48 ftm-opera[1700935]: github.com/cockroachdb/pebble.(*Batch).Delete(0xc013ded440?, {0xc043abea20?, 0x21?, 0xc04333d700?}, 0x21?)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/cockroachdb/pebble@v0.0.0-20221111210721-1bda21f14fc2/batch.go:583 +0x31
Mar 12 16:03:48 ftm-opera[1700935]: github.com/Fantom-foundation/lachesis-base/kvdb/pebble.(*batch).Delete(0xc01499be30, {0xc043abea20?, 0xc010211748?, 0xc043abea20?})
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/lachesis-base@v0.0.0-20230817040848-1326ba9aa59b/kvdb/pebble/pebble.go:436 +0x31
Mar 12 16:03:48 ftm-opera[1700935]: github.com/ethereum/go-ethereum/core/rawdb.DeleteAccountSnapshot({0x7f5d581b1388, 0xc01475be40}, {0xbb, 0x54, 0x80, 0xe1, 0x17, 0x10, 0x25, 0x15, ...})
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/go-ethereum@v1.10.8-ftm-rc12/core/rawdb/accessors_snapshot.go:90 +0xdc
Mar 12 16:03:48 ftm-opera[1700935]: github.com/ethereum/go-ethereum/core/state/snapshot.(*diskLayer).generate.func2({0xc043fd8480, 0x20, 0x20}, {0x0, 0x0, 0x0}, 0x0, 0x1)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/go-ethereum@v1.10.8-ftm-rc12/core/state/snapshot/generate.go:595 +0x205
Mar 12 16:03:48 ftm-opera[1700935]: github.com/ethereum/go-ethereum/core/state/snapshot.(*diskLayer).generateRange(0xc013ff57a0, {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/go-ethereum@v1.10.8-ftm-rc12/core/state/snapshot/generate.go:514 +0x13a3
Mar 12 16:03:48 ftm-opera[1700935]: github.com/ethereum/go-ethereum/core/state/snapshot.(*diskLayer).generate(0xc013ff57a0, 0xc0142f0bc0)
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/go-ethereum@v1.10.8-ftm-rc12/core/state/snapshot/generate.go:708 +0x396
Mar 12 16:03:48 ftm-opera[1700935]: created by github.com/ethereum/go-ethereum/core/state/snapshot.generateSnapshot
Mar 12 16:03:48 ftm-opera[1700935]:         /root/go/pkg/mod/github.com/!fantom-foundation/go-ethereum@v1.10.8-ftm-rc12/core/state/snapshot/generate.go:168 +0x339
Mar 12 16:03:49 systemd[1]: fantom.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Mar 12 16:03:49 systemd[1]: fantom.service: Failed with result 'exit-code'.