Fast sync 중 Bad Block 에러 (최신버전 ken)

한국어🇰🇷 클레이튼
1

EN 설치를 위해 최신 chaindata를 받아 fast sync 중입니다.
아래와 같은 Bad Block 에러(여러 블록에서)와 “too many open files” 에러가 계속해서 발생합니다.
에러가 발생해도 block sync 가 재개되긴 하지만, sync가 중단되며 kend down 되기도 합니다.
그렇게 최신블록까지 동기화를 했을 때에 정상적으로 동기화가 된 것인지도 확신이 없습니다.
어떤 문제인지 파악하실 수 있을까요?

INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723885 hash=6293f0…cde603                                                      txs=6   gas=314439   elapsed=34.799ms    processTxs=2.267ms   finalize=1.118ms   validateState=77.151µs  totalWrite=22.032242ms  trieWrite=2.147871ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723886 hash=b2e5f9…ed2ebf                                                      txs=5   gas=693525   elapsed=31.812ms    processTxs=4.226ms   finalize=1.362ms   validateState=250.986µs totalWrite=20.658083ms  trieWrite=2.94248ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723887 hash=64a987…8ca04d                                                      txs=7   gas=834057   elapsed=58.499ms    processTxs=13.648ms  finalize=5.525ms   validateState=491.842µs totalWrite=31.285799ms  trieWrite=5.362676ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723888 hash=8a1eb0…10076d                                                      txs=2   gas=289044   elapsed=48.378ms    processTxs=2.221ms   finalize=1.853ms   validateState=77.545µs  totalWrite=33.095028ms  trieWrite=2.514385ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723889 hash=da152f…a70cff                                                      txs=4   gas=347591   elapsed=34.554ms    processTxs=1.869ms   finalize=897.209µs validateState=67.553µs  totalWrite=21.847643ms  trieWrite=1.800675ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723890 hash=2e9930…a1b6b3                                                      txs=2   gas=89164    elapsed=28.303ms    processTxs=436.031µs finalize=535.339µs validateState=29.375µs  totalWrite=20.190038ms  trieWrite=1.409032ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723891 hash=60752d…96b672                                                      txs=10  gas=842748   elapsed=39.064ms    processTxs=8.994ms   finalize=1.569ms   validateState=147.466µs totalWrite=20.637986ms  trieWrite=2.819087ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723892 hash=cb5dcf…15c7b2                                                      txs=11  gas=2073036  elapsed=38.749ms    processTxs=10.306ms  finalize=1.835ms   validateState=229.495µs totalWrite=19.726558ms  trieWrite=2.70283ms
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723893 hash=29cdb3…3e04eb                                                      txs=7   gas=563171   elapsed=29.410ms    processTxs=2.126ms   finalize=1.118ms   validateState=163.601µs totalWrite=19.95466ms   trieWrite=1.92624ms
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
INFO[04/25,08:50:25 Z] [5] Inserted a new block                      number=88723894 hash=ec2ae7…c3aa0d                                                      txs=0   gas=0        elapsed=23.072ms    processTxs=128ns     finalize=282.507µs validateState=6.576µs   totalWrite=17.670153ms  trieWrite=1.214054ms
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/251548.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/251548.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/251548.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/251548.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/251548.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/259125.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/259125.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/259125.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/259125.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/221224.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/221224.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/221224.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/221224.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/221224.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/251820.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/251820.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/251820.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/251820.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/256106.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/244740.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/242257.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [5]
########## BAD BLOCK #########
Chain config: {ChainID: 8217 IstanbulCompatibleBlock: 86816005 LondonCompatibleBlock: 86816005 EthTxTypeCompatibleBlock: 86816005 SubGroupSize: 22 UnitPrice: 750000000000 DeriveShaImpl: 2 Engine: istanbul}

Number: 88723895
Hash: 0xddd50b8b2cdc41ff0c0ed2f7abc82e0cf5ce2110d201ff374ba91401e6437281


Error: nonce too high
##############################

WARN[04/25,08:50:25 Z] [28] Synchronisation failed, dropping peer     peer=ff79be330048e18a err="retrieved hash chain is invalid: nonce too high"
WARN[04/25,08:50:25 Z] [33] ProtocolManager failed to read msg        id=ff79be330048e18a conn=inbound            err=EOF
INFO[04/25,08:50:25 Z] [33] [Dial] Add dial candidate from static nodes  id=ff3f708eb8753df1 NodeType=2 ip=18.139.58.176  mainPort=32323 port="[32323 32324]"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/260041.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/261319.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/261319.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/261319.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/261319.ldb: too many open files"
ERROR[04/25,08:50:25 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/260041.ldb: too many open files"
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723895 hash=ddd50b…437281                                                      txs=3   gas=133385   elapsed=42.575ms    processTxs=671.32µs  finalize=691.338µs validateState=30.876µs  totalWrite=30.04085ms   trieWrite=1.290358ms
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723896 hash=eb1e37…9af3ac                                                      txs=8   gas=777195   elapsed=41.474ms    processTxs=4.125ms   finalize=1.439ms   validateState=122.104µs totalWrite=25.812349ms  trieWrite=2.574762ms
INFO[04/25,08:50:29 Z] [5] Imported new chain segment                number=88723896 hash=eb1e37…9af3ac                                                      blocks=2   txs=11  elapsed=84.827ms    trieDBSize=11.30mB  mgas=0.911   mgasps=10.734 age=3d1h30m
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723897 hash=047e74…669178                                                      txs=10  gas=842834   elapsed=39.989ms    processTxs=5.125ms   finalize=1.695ms   validateState=318.956µs totalWrite=23.224256ms  trieWrite=2.729261ms
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723898 hash=eed69d…d6482b                                                      txs=18  gas=1641805  elapsed=35.614ms    processTxs=7.842ms   finalize=2.069ms   validateState=327.116µs totalWrite=19.223197ms  trieWrite=3.109413ms
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723899 hash=3e4c29…53f36e                                                      txs=5   gas=339671   elapsed=29.993ms    processTxs=5.059ms   finalize=835.479µs validateState=104.313µs totalWrite=18.852108ms  trieWrite=1.886372ms
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723900 hash=75b130…726ac4                                                      txs=11  gas=1307436  elapsed=41.442ms    processTxs=16.132ms  finalize=1.795ms   validateState=181.301µs totalWrite=17.920591ms  trieWrite=3.117061ms
INFO[04/25,08:50:29 Z] [5] Inserted a new block                      number=88723901 hash=461d75…cb27bb                                                      txs=1   gas=37337    elapsed=22.966ms    processTxs=277.88µs  finalize=486.721µs validateState=21.507µs  totalWrite=17.22041ms   trieWrite=1.181398ms
2

invalid merkle root 에러도 발생합니다.
Bad Block에러가 찍히는 블록은 실제로는 유효한 블록입니다.

INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737879 hash=4d389b…622c41 txs=10 gas=1170381 elapsed=64.869ms   processTxs=18.883ms finalize=2.644ms validateState=137.088µs totalWrite=28.656139ms trieWrite=3.048918ms
INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737880 hash=8b38b4…238df5 txs=4  gas=20201417 elapsed=353.952ms  processTxs=302.137ms finalize=5.052ms validateState=214.694µs totalWrite=35.881495ms trieWrite=10.468823ms
INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737881 hash=2e5418…8ba8a3 txs=3  gas=333520   elapsed=42.241ms   processTxs=1.940ms   finalize=1.113ms validateState=154.374µs totalWrite=28.634771ms trieWrite=1.765612ms
INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737882 hash=46a4a4…b1dc5c txs=10 gas=1030799  elapsed=54.322ms   processTxs=4.187ms   finalize=2.252ms validateState=405.185µs totalWrite=37.373497ms trieWrite=3.070157ms
INFO[04/25,09:06:27 Z] [5] Imported new chain segment                number=88737882 hash=46a4a4…b1dc5c blocks=4 txs=27 elapsed=517.774ms  trieDBSize=1.50mB mgas=22.736 mgasps=43.911 age=2d21h49m
INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737883 hash=870f0a…f524ee txs=0  gas=0        elapsed=51.694ms   processTxs=541ns     finalize=650.574µs validateState=13.256µs  totalWrite=34.609262ms trieWrite=1.138925ms
INFO[04/25,09:06:27 Z] [5] Inserted a new block                      number=88737884 hash=9da517…b31cb9 txs=4  gas=239383   elapsed=67.414ms   processTxs=1.930ms   finalize=6.335ms   validateState=139.508µs totalWrite=42.717278ms trieWrite=2.696532ms
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/261514.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/258184.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/243584.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/269204.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/0/249765.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/258951.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/261543.ldb: too many open files"
ERROR[04/25,09:06:27 Z] [5]
########## BAD BLOCK #########
Chain config: {ChainID: 8217 IstanbulCompatibleBlock: 86816005 LondonCompatibleBlock: 86816005 EthTxTypeCompatibleBlock: 86816005 SubGroupSize: 22 UnitPrice: 750000000000 DeriveShaImpl: 2 Engine: istanbul}

Number: 88737885
Hash: 0xb7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf
	 0: tx: 0x75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 status: 1 gas: 152022 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000040000000000000008000000000000000020000008000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000040000000000800000002000040000000000000000000000000000000000002000000000000002000000000000000000000000020001000000000000004000800000000000000000000000000000000000000000000000000000000000000000008000 logs: [log: 5096db80b21ef45230c9e423c373f1fc9c0198dd [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000003cb3890004e8f5a6885c1d8d359e8c2946b504f3 000000000000000000000000af79f52c8f01f19b4811d168e99a0d11a9063eec] 000000000000000000000000000000000000000000000000025f2aeb13b9e800 75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 0 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 0 log: 3cb3890004e8f5a6885c1d8d359e8c2946b504f3 [77cbb7000e85fd5710298ad56f5700a72faf900655230431f6b604cd6c1410db 000000000000000000000000af79f52c8f01f19b4811d168e99a0d11a9063eec] 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000005096db80b21ef45230c9e423c373f1fc9c0198dd000000000000000000000000000000000000000000000000025f2aeb13b9e80023c6d93c8fc3363e5b5d3b7608655a9c6b59eb533523cc77c794512ece4245b7 75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 0 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 1]
	 1: tx: 0x2a8a1bc1eaa387d528f7b0a504b57dcaa1a78719baa1e81e71d8addebd65b526 status: 1 gas: 226509 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002100000000002008000000000000000000000000000001000000000000000000020000000000000000000800000000000000000000000010000000000000000000080000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000040002000002000000000000000000000000000000000000000001000020000000000000000000000000000000000000000000000000000000000000000000 logs: [log: 701f9f50da60c04d971f8bc6fadc0dd25b7a8366 [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000005496c7e54af832e18ead334fe22eb59b2d469559 0000000000000000000000000000000000000000000000000000000000000449]  2a8a1bc1eaa387d528f7b0a504b57dcaa1a78719baa1e81e71d8addebd65b526 1 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 2]
	 2: tx: 0x21e7db33e0d611acf03088a36f736775c290a92613b3636e12427db57e39ac78 status: 1 gas: 37337 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000008000000000000000000000000000010000000000000000000000000000000000000000000000000000000020000008000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000400000000008000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000800000000000200000000000000000000000000000000000 logs: [log: 5096db80b21ef45230c9e423c373f1fc9c0198dd [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000007d4169ec0e769e8fffe32f7648449c3e96ea0565 0000000000000000000000001d275fb1417dd6403a15ff7175c3dc3ecab41f74] 000000000000000000000000000000000000000000000000025f2aeb13b9e800 21e7db33e0d611acf03088a36f736775c290a92613b3636e12427db57e39ac78 2 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 3]
	 3: tx: 0x9a0a7db4c8dd80f45df8ae868ae460b3de849d3739a8d003ebe5246796bc091b status: 1 gas: 21000 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 logs: []
	 4: tx: 0x58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 status: 1 gas: 192374 contract: 0x0000000000000000000000000000000000000000 bloom: 00001000000000000000000800008000000000000000000000000000000000800000000000000000000200000000000000400000000000000000000080000000000000000000080000000008000000000000000100000000000000000000000000000000020000000000000000000800000000000002000008000010000000000000000000100000000000000000000000000000000000000000000000000000000000004001000000000000000000000000000000000000000000000000000000000002040000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000 logs: [log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 0000000000000000000000000000000000000000000000000000000000000000 00000000000000000000000000000000000000000000000000000000000018a1]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 4 log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 0000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000001b02]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 5 log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000000000000000000000000000000000000000000000 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 000000000000000000000000000000000000000000000000000000000000498f]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 6]


Error: invalid merkle root (remote: a74b6aa9586c4f19e37eb955c32547f9a08add1bfa06499bac2e4d2dd961e831 local: 7badeaa3d523a9a92cd1aefcebcd6282bb48e4b6fe8192ff2b986fb061d62f57)
##############################

WARN[04/25,09:06:27 Z] [28] Synchronisation failed, dropping peer     peer=69f045acf2fb9a70 err="retrieved hash chain is invalid: invalid merkle root (remote: a74b6aa9586c4f19e37eb955c32547f9a08add1bfa06499bac2e4d2dd961e831 local: 7badeaa3d523a9a92cd1aefcebcd6282bb48e4b6fe8192ff2b986fb061d62f57)"
WARN[04/25,09:06:27 Z] [33] ProtocolManager failed to read msg        id=69f045acf2fb9a70 conn=inbound err=EOF
WARN[04/25,09:06:27 Z] [33] ProtocolManager failed to read msg        id=69f045acf2fb9a70 conn=inbound err=EOF
INFO[04/25,09:06:27 Z] [33] Disconnected a multichannel P2P Peer      id=69f045acf2fb9a70 conn=inbound peerID=69f045acf2fb9a70 peerName=Klaytn/v1.8.2+7584e71de6/linux-amd64/go1.15.7 err=EOF
INFO[04/25,09:06:27 Z] [33] [Dial] Add dial candidate from static nodes  id=81c44374fe0ff0ab NodeType=2 ip=13.209.215.234 mainPort=32323 port="[32323 32324]"
INFO[04/25,09:06:27 Z] [33] [Dial] Add dial candidate from static nodes  id=781137a784e037a4 NodeType=2 ip=110.76.140.23  mainPort=32323 port=[32323]
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/261514.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/258184.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/243584.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/3/269204.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/0/249765.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/1/258951.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [47] Unexpected error while reading cached trie node  err="open /home/ec2-user/kend_home/klay/chaindata/statetrie_migrated_87145087/2/261543.ldb: too many open files"
ERROR[04/25,09:06:28 Z] [5]
########## BAD BLOCK #########
Chain config: {ChainID: 8217 IstanbulCompatibleBlock: 86816005 LondonCompatibleBlock: 86816005 EthTxTypeCompatibleBlock: 86816005 SubGroupSize: 22 UnitPrice: 750000000000 DeriveShaImpl: 2 Engine: istanbul}

Number: 88737885
Hash: 0xb7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf
	 0: tx: 0x75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 status: 1 gas: 152022 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000040000000000000008000000000000000020000008000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000040000000000800000002000040000000000000000000000000000000000002000000000000002000000000000000000000000020001000000000000004000800000000000000000000000000000000000000000000000000000000000000000008000 logs: [log: 5096db80b21ef45230c9e423c373f1fc9c0198dd [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000003cb3890004e8f5a6885c1d8d359e8c2946b504f3 000000000000000000000000af79f52c8f01f19b4811d168e99a0d11a9063eec] 000000000000000000000000000000000000000000000000025f2aeb13b9e800 75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 0 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 0 log: 3cb3890004e8f5a6885c1d8d359e8c2946b504f3 [77cbb7000e85fd5710298ad56f5700a72faf900655230431f6b604cd6c1410db 000000000000000000000000af79f52c8f01f19b4811d168e99a0d11a9063eec] 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000005096db80b21ef45230c9e423c373f1fc9c0198dd000000000000000000000000000000000000000000000000025f2aeb13b9e80023c6d93c8fc3363e5b5d3b7608655a9c6b59eb533523cc77c794512ece4245b7 75bc9b53d182fb07d858e5d75f6c8a56851713c3e4346c92488823c846a4ae76 0 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 1]
	 1: tx: 0x2a8a1bc1eaa387d528f7b0a504b57dcaa1a78719baa1e81e71d8addebd65b526 status: 1 gas: 226509 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002100000000002008000000000000000000000000000001000000000000000000020000000000000000000800000000000000000000000010000000000000000000080000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000040002000002000000000000000000000000000000000000000001000020000000000000000000000000000000000000000000000000000000000000000000 logs: [log: 701f9f50da60c04d971f8bc6fadc0dd25b7a8366 [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000005496c7e54af832e18ead334fe22eb59b2d469559 0000000000000000000000000000000000000000000000000000000000000449]  2a8a1bc1eaa387d528f7b0a504b57dcaa1a78719baa1e81e71d8addebd65b526 1 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 2]
	 2: tx: 0x21e7db33e0d611acf03088a36f736775c290a92613b3636e12427db57e39ac78 status: 1 gas: 37337 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000008000000000000000000000000000010000000000000000000000000000000000000000000000000000000020000008000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000400000000008000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000800000000000200000000000000000000000000000000000 logs: [log: 5096db80b21ef45230c9e423c373f1fc9c0198dd [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000007d4169ec0e769e8fffe32f7648449c3e96ea0565 0000000000000000000000001d275fb1417dd6403a15ff7175c3dc3ecab41f74] 000000000000000000000000000000000000000000000000025f2aeb13b9e800 21e7db33e0d611acf03088a36f736775c290a92613b3636e12427db57e39ac78 2 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 3]
	 3: tx: 0x9a0a7db4c8dd80f45df8ae868ae460b3de849d3739a8d003ebe5246796bc091b status: 1 gas: 21000 contract: 0x0000000000000000000000000000000000000000 bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 logs: []
	 4: tx: 0x58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 status: 1 gas: 192374 contract: 0x0000000000000000000000000000000000000000 bloom: 00001000000000000000000800008000000000000000000000000000000000800000000000000000000200000000000000400000000000000000000080000000000000000000080000000008000000000000000100000000000000000000000000000000020000000000000000000800000000000002000008000010000000000000000000100000000000000000000000000000000000000000000000000000000000004001000000000000000000000000000000000000000000000000000000000002040000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000 logs: [log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 0000000000000000000000000000000000000000000000000000000000000000 00000000000000000000000000000000000000000000000000000000000018a1]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 4 log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 0000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000001b02]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 5 log: 16c15581818ba99472b0ff7616d05fe1fd7cd44d [ddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef 0000000000000000000000000000000000000000000000000000000000000000 000000000000000000000000e25b840f968c8af083c900517d154a4f513271e3 000000000000000000000000000000000000000000000000000000000000498f]  58ae975de6befca206fae9e8d67eada72bfa35b41d421b954e2499ea466d1983 4 b7e884c0d730340d6c475646157da1d9b84b28970a094bedc8f52c189c207bdf 6]


Error: invalid merkle root (remote: a74b6aa9586c4f19e37eb955c32547f9a08add1bfa06499bac2e4d2dd961e831 local: 7badeaa3d523a9a92cd1aefcebcd6282bb48e4b6fe8192ff2b986fb061d62f57)
##############################

WARN[04/25,09:06:28 Z] [28] Synchronisation failed, dropping peer     peer=345d9e492e3c7047 err="retrieved hash chain is invalid: invalid merkle root (remote: a74b6aa9586c4f19e37eb955c32547f9a08add1bfa06499bac2e4d2dd961e831 local: 7badeaa3d523a9a92cd1aefcebcd6282bb48e4b6fe8192ff2b986fb061d62f57)"
WARN[04/25,09:06:28 Z] [33] ProtocolManager failed to read msg        id=345d9e492e3c7047 conn=inbound err=EOF
WARN[04/25,09:06:28 Z] [33] ProtocolManager failed to read msg        id=345d9e492e3c7047 conn=inbound err=EOF
INFO[04/25,09:06:28 Z] [33] Disconnected a multichannel P2P Peer      id=345d9e492e3c7047 conn=inbound peerID=345d9e492e3c7047 peerName=Klaytn/v1.8.1+275b47b11e/linux-amd64/go1.15.7 err=EOF
INFO[04/25,09:06:29 Z] [33] Added a single channel P2P Peer           id=ff79be330048e18a conn=inbound peerID=ff79be330048e18a
INFO[04/25,09:06:29 Z] [33] Added a multichannel P2P Peer             id=17717ff7f20df058 conn=inbound peerID=17717ff7f20df058
4

안녕하세요. 클레이튼 포럼에 글을 남겨주셔서 감사합니다.
혹시 바이너리 버전 및 OS 공유 가능하신가요?
klaytn docs에 나와있는 하드웨어 스펙에 질문자님 EN 스펙이 맞는지도 궁금합니다.

5

ken version
Klaytn v1.8.2+7584e71de6

m5.4xlarge Amazon Linux
하드웨어 스펙 문제는 아닌듯합니다.

6

안녕하세요

디스크 스펙도 알려주실 수 있나요?

leveldb에서 발생하는 이슈인거같은데

도커 이미지로 띄워보시겠어요?

아래 cypress docker-compose 참고부탁드립니다.

7

디스크는 Amazon EBS gp3 IOPS 3000 이상입니다.
하드웨어 스펙 문제는 아닌 듯 합니다.

Level DB 쪽 버그라 생각되면 공유하겠습니다.