클레이튼 cypress en node snyc 오류

한국어🇰🇷 클레이튼
1

Cypress EN 노드를 운영하던 중에 data volume이 가득 차서 노드가 며칠 멈췄었고, 볼륨 증설 후 sync에 문제가 생겨 문의 드립니다.

INFO[02/06,02:07:17 Z] [31] Enabling metrics collection
INFO[02/06,02:07:17 Z] [31] Enabling Prometheus Exporter
INFO[02/06,02:07:17 Z] [18] Setting connection type                   nodetype=en conntype=1
INFO[02/06,02:07:17 Z] [18] Setting MaxPhysicalConnections            MaxPhysicalConnections=10
INFO[02/06,02:07:17 Z] [18] A private network ID is set               networkid=8217
INFO[02/06,02:07:17 Z] [18] Set the concurrency limit of RPC-HTTP server  limit=3000
INFO[02/06,02:07:17 Z] [18] Raised fd limit to process's maximum value  fd=524288
INFO[02/06,02:07:17 Z] [18] A private network ID is set               networkid=8217
INFO[02/06,02:07:17 Z] [18] Archiving mode of this node               isArchiveMode=false
INFO[02/06,02:07:17 Z] [40] Starting peer-to-peer node                instance=Klaytn/v1.9.0+51c0105b62/linux-amd64/go1.15.7
INFO[02/06,02:07:17 Z] [48] Non-single database is used for persistent storage  DBType=LevelDB
INFO[02/06,02:07:17 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/misc levelDBCacheSize=16 openFilesLimit=5242 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:17 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/header levelDBCacheSize=38 openFilesLimit=13107 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:18 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/body   levelDBCacheSize=38 openFilesLimit=13107 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:18 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/receipts levelDBCacheSize=38 openFilesLimit=13107 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:18 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/statetrie_migrated_93361992/0 levelDBCacheSize=76 openFilesLimit=26214 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:19 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/statetrie_migrated_93361992/1 levelDBCacheSize=76 openFilesLimit=26214 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:20 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/statetrie_migrated_93361992/2 levelDBCacheSize=76 openFilesLimit=26214 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:20 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/statetrie_migrated_93361992/3 levelDBCacheSize=76 openFilesLimit=26214 useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:21 Z] [48] Created a sharded database                dbType=statetrie numShards=4
INFO[02/06,02:07:21 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/txlookup                      levelDBCacheSize=16 openFilesLimit=5242  useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:21 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/bridgeservice                 levelDBCacheSize=16 openFilesLimit=2621  useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:21 Z] [48] LevelDB configurations                    path=/home/ubuntu/data/klay/chaindata/snapshot                      levelDBCacheSize=22 openFilesLimit=7864  useBufferPool=true usePerfCheck=true compressionType=none compactionTableSize(MB)=2 compactionTableSizeMultiplier=1.000
INFO[02/06,02:07:21 Z] [30] Successfully loaded governance state from database  blockNumber=112321536
INFO[02/06,02:07:21 Z] [41] Initialised chain configuration           config="{ChainID: 8217 IstanbulCompatibleBlock: 86816005 LondonCompatibleBlock: 86816005 EthTxTypeCompatibleBlock: 86816005 MagmaCompatibleBlock: 99841497 SubGroupSize: 22 UnitPrice: 250000000000 DeriveShaImpl: 2 Engine: istanbul}"
INFO[02/06,02:07:21 Z] [41] Initialising Klaytn protocol              versions="[65 64]" network=8217
INFO[02/06,02:07:21 Z] [5] Using DeriveShaConcat!
INFO[02/06,02:07:21 Z] [49] Initializing local trie node cache (fastCache)  MaxMiB=9475 FilePath=/home/ubuntu/data/klay/fastcache
INFO[02/06,02:07:21 Z] [49] Initialized local trie node cache (fastCache)  LoadedMiB=0 LoadedEntries=0 elapsed=3.051263ms
INFO[02/06,02:07:21 Z] [5] Loaded most recent local header           number=112321663 hash=2f2876…1194c4 td=112321664 age=2w2d10h
INFO[02/06,02:07:21 Z] [5] Loaded most recent local full block       number=112321536 hash=c5e403…4c810d td=112321537 age=2w2d10h
INFO[02/06,02:07:21 Z] [5] Loaded most recent local fast block       number=112321663 hash=2f2876…1194c4 td=112321664 age=2w2d10h
INFO[02/06,02:07:21 Z] [5] prefetchTxWorkers are started             num=32
INFO[02/06,02:07:21 Z] [5] Loaded local transaction journal          transactions=0 dropped=0
INFO[02/06,02:07:21 Z] [5] Regenerated local transaction journal     transactions=0 accounts=0
INFO[02/06,02:07:21 Z] [40] Starting P2P networking
INFO[02/06,02:07:23 Z] [34] UDP listener up                           self="kni://15592a6ede8d2d8b6e98e5aa3b8cee5d338efc5a65553bd4b665c1b2544cc153cc598174fa9900c83084ab22efd622dc05ce6c43383c95a5249610c53d5516ce@[::]:32323?ntype=en"
INFO[02/06,02:07:23 Z] [40] Started P2P server                        id=15592a6ede8d2d8b multichannel=true
INFO[02/06,02:07:23 Z] [40] RLPx listener up                          self="kni://xxxxxxxxxxx@[::]:32323?ntype=en"
INFO[02/06,02:07:23 Z] [40] RLPx listener up                          self="kni://xxxxxxxxxxx@[::]:32323?ntype=en"
INFO[02/06,02:07:23 Z] [44] Start listening chain head event to update stakingInfoCache.
INFO[02/06,02:07:23 Z] [40] IPC endpoint opened                       url=/home/ubuntu/data/klay/klay.ipc
INFO[02/06,02:07:23 Z] [40] FastHTTP endpoint opened                  url=http://0.0.0.0:8545             cors=* vhosts=*
INFO[02/06,02:07:23 Z] [40] FastWebSocket endpoint opened             url=ws://0.0.0.0:8546
INFO[02/06,03:07:21 Z] [5] Regenerated local transaction journal     transactions=0 accounts=0
INFO[02/06,04:07:21 Z] [5] Regenerated local transaction journal     transactions=0 accounts=0

Regenerated local transaction journal transactions=0 accounts=0 라는 로그가 1시간에 1번씩만 찍히고, 그 이상의 진척이 없어보입니다.

Verbosity를 5로 높혀 찍으니

TRACE[02/06,05:06:03 Z] [33] discoverTask wakeup
DEBUG[02/06,05:06:03 Z] [34] lookup start                              Discover=Kademlia StorageName=EN targetID=d17f42d6fc64dce1 targetNodeType=EN refreshIfEmpty=true
TRACE[02/06,05:06:03 Z] [34] doRefresh()                               Discover=Table
DEBUG[02/06,05:06:03 Z] [34] lookup                                    Discover=Simple   StorageName=PN targetId=0000000000000000 targetType=PN
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=2
TRACE[02/06,05:06:03 Z] [33] discoverTypedStaticTask                   result=0
TRACE[02/06,05:06:03 Z] [40] Dial task done                            task="discover TypedStaticTask: max: 2"
TRACE[02/06,05:06:03 Z] [33] [Dial] discoverTypedStaticTask - done     t.name=PN result count=0
TRACE[02/06,05:06:03 Z] [33] [Dial] Dynamic Dials Remained Capacity    needDynDials=3 maxDynDials=3
DEBUG[02/06,05:06:03 Z] [33] [Dial] Add new discoverTypedStaticTask    name=PN
TRACE[02/06,05:06:03 Z] [40] New dial task                             task="discover TypedStaticTask: max: 2"
DEBUG[02/06,05:06:03 Z] [34] lookup start                              Discover=Kademlia StorageName=EN targetID=15592a6ede8d2d8b targetNodeType=EN refreshIfEmpty=false
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=3
DEBUG[02/06,05:06:03 Z] [34] lookup start                              Discover=Kademlia StorageName=EN targetID=5f5a23149315c9c3 targetNodeType=EN refreshIfEmpty=false
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=3
DEBUG[02/06,05:06:03 Z] [34] lookup start                              Discover=Kademlia StorageName=EN targetID=a87c03f1f293912a targetNodeType=EN refreshIfEmpty=false
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=3
DEBUG[02/06,05:06:03 Z] [34] lookup start                              Discover=Kademlia StorageName=EN targetID=51adcbaeb2b8ba39 targetNodeType=EN refreshIfEmpty=false
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=3
DEBUG[02/06,05:06:03 Z] [34] findNewNode: found nodes                  Discover=Table    length=0 nodeType=3
TRACE[02/06,05:06:03 Z] [40] Dial task done                            task="discovery lookup"
TRACE[02/06,05:06:03 Z] [33] [Dial] Dynamic Dials Remained Capacity    needDynDials=3 maxDynDials=3
TRACE[02/06,05:06:03 Z] [40] New dial task                             task="discovery lookup"
TRACE[02/06,05:06:03 Z] [33] discoverTask sleep                        period=3.999370204s

이런 로그가 나오는데, 어떻게 해결을 해야하나요?

2

ken binary 버전이 어떻게 되시나요?

추가적으로 볼륨 증설 후 방화벽에서 32323, 32324 포트를 막아놓으셨는지 확인가능할까요?

3

ken version은 1.9.0이고,
inbound는 32323 - 32324 0.0.0/0으로 다 열려 있습니다.

4

다른쪽 더 봐야할 부분은 없을까요? 노드가 계속 멈춰있는 상태라서요…

5

현재 로그로는 다른 노드와 연결이 되지 않은 것으로 보입니다. admin.peers 명령어를 통해 연결된 노드가 있는지 확인하실 수 있습니다.

다른 노드와 연결이 안된 이유는 지금 정보로는 파악하기 힘들지만, 기존과 동일한 환경이라면 네트워크 설정의 문제는 아닐 것으로 보입니다. 우선, 직접 PN 정보를 입력하여 static하게 peer 연결을 시도해 보는 것도 한 방법입니다.

아래 링크를 참조해서 특정 PN에게 직접 연결을 시도해보시는 것도 좋을 것 같습니다.

1개의 좋아요
6

아 네네. peer 의 문제였네요. addPeer로 해결했습니다. 감사합니다.