- 积分
- 16840
在线时间 小时
最后登录1970-1-1
|
马上注册,结交更多好友,享用更多功能,让你轻松玩转社区。
您需要 登录 才可以下载或查看,没有账号?开始注册
x
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
, X# L* K' L* w- g- l# D# DJun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
# i& i. L: F7 r: S8 |Jun 7 14:35:18 controller2 systemd: Started RabbitMQ broker.
7 k4 M0 w5 }- g0 F0 FJun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)
! a& O2 Y9 E9 a w$ \Jun 7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
' I! n2 W" U% GJun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false)
0 u, C+ n7 _4 F# F- l' |5 `Jun 7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}
' \8 i6 k. a# tJun 7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
( |( Z9 l# z: u J3 `" m! yJun 7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()
]3 e5 R# g- Z% {/ D& \+ M1 dJun 7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
; M5 m8 ]' \/ B' u UJun 7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...7 M+ \! U7 H" Y, ` x {6 ]
Jun 7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown1 L; g) u4 l5 Z# p! k: U
Jun 7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS/ N/ Z6 w2 k4 G% G
Jun 7 14:35:20 controller2 rabbitmqctl: ===========. a: x% S% M+ [# r+ |3 C
Jun 7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']) n4 E0 g) v( W/ Q
Jun 7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:
0 p# b; a1 o; Y8 @" tJun 7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
: s0 h" u5 y$ w, h' h3 jJun 7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all& U5 W3 d4 w _) r! _7 a" B% x( Q
Jun 7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
" i; ^2 L! u6 C! mJun 7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node$ v( C6 o3 i$ N9 c; l+ c
Jun 7 14:35:20 controller2 rabbitmqctl: current node details:4 ?% k: ^5 c+ Q) @
Jun 7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2'$ {1 s. p m. o. S8 n1 {0 t: m
Jun 7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq
$ c$ `; b+ M7 _9 b! WJun 7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==/ q/ M0 t! s2 d7 H: x! m3 K$ u) W2 e
Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
$ ~/ k8 G" C& G0 q$ xJun 7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.
% H7 k" _6 o9 I2 b" ZJun 7 14:35:20 controller2 systemd: rabbitmq-server.service failed.: v5 ?. V! F4 E
9 y1 _$ K6 w3 R; ?' b& }3 r+ d* @
0 m+ b. U; y& g" y8 _
. V" w4 T$ g \8 f- {' p+ b; ?Jun 7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5
* k: x! X) y3 h6 c% j+ ~- `( NJun 7 14:35:25 controller2 systemd: Starting RabbitMQ broker...
+ C0 G& A) {7 @5 f# l" Q0 t# D4 `Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984, Y* b$ _( e( {: D9 m9 x
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984! q/ z, d) p- o: {, j
Jun 7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
1 n( L/ K) G3 S/ ]/ `Jun 7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...
2 Z7 I! m S) A1 F3 X, \Jun 7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.8 O+ [% h6 N/ w3 N- ]
Jun 7 14:35:27 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/
$ b- L/ ~ A& ~3 w/ T" l) RJun 7 14:35:27 controller2 rabbitmq-server: ## ##
0 O1 l/ C) I/ SJun 7 14:35:27 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log8 w2 d( T0 b: @6 L
Jun 7 14:35:27 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log" `3 I' P3 N7 N& }; P2 ^6 M
Jun 7 14:35:27 controller2 rabbitmq-server: ##########
* M: I P# ] ?& VJun 7 14:35:27 controller2 rabbitmq-server: Starting broker...
, p' T5 B {: U3 G2 S0 GJun 7 14:35:27 controller2 rabbitmq-server: BOOT FAILED- c: J- d& ?. z# w" k( p
Jun 7 14:35:27 controller2 rabbitmq-server: ===========2 G1 `( }9 p: }1 S! H% Q8 S" L
Jun 7 14:35:27 controller2 rabbitmq-server: Error description:
: }; i6 j( [$ [Jun 7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,
9 l M0 X3 V7 D$ }' N5 EJun 7 14:35:27 controller2 rabbitmq-server: {badmatch,
# A" q, K5 T; u" Q6 eJun 7 14:35:27 controller2 rabbitmq-server: {error," N2 ^2 O9 {4 ~0 r, y
Jun 7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
G: q2 h" I( H3 R& {8 N5 aJun 7 14:35:27 controller2 rabbitmq-server: {error,! w/ `+ ]7 D Z3 m& S9 u; |9 Y
Jun 7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,4 ] {) g4 }' S( v! |6 Y2 E0 B
Jun 7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},5 }" q) ^0 D+ g7 A; E
Jun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,- Y h2 y# W2 d' ~% m/ J
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
/ x4 L$ E/ I& T8 o' lJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
" i9 {0 c. |* A6 [- t) ?$ mJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},, G0 h: p2 [: y: w$ y o
Jun 7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
* N1 ]; e4 }: P2 \) eJun 7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,% v" R8 x& M U
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},) j0 y: B7 l g( L2 O0 g; {
Jun 7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,: }( p& a# A4 V3 u
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},& b3 [/ M& h+ ~6 L( [$ J$ t) i2 J
Jun 7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,; K5 }$ h: w% ~: G w. m" {- g p1 X
Jun 7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}4 y; L; D+ F' w2 v# L
Jun 7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):
; J$ o6 n4 X: z7 ~) kJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
. C+ h7 V+ [$ s5 O s( B1 ~) NJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log/ N9 }; R$ ]3 q6 S
Jun 7 14:35:27 controller2 rabbitmq-server: Stack trace:! @2 L$ A4 ~4 x6 h
Jun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,
% {, u" Z0 Q& R! F+ \5 g1 JJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},
. ]' S2 A! j! F, x% mJun 7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
( W8 {! L, j+ l" Y2 r+ Z RJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},( g$ |7 o4 J0 I( v: P" i3 Z0 j/ F
Jun 7 14:35:27 controller2 rabbitmq-server: {line,402}]},
4 `% f0 ?& Q& h& K9 s% |Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},
. x0 L- Q: E6 J- G- Y& uJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},
: V- A) a! g s8 @, u' ]1 pJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},/ D L* e9 g# v' V! I/ a5 p& [1 T
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
6 V+ P3 l5 H* _8 _& rJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
! a" ?. X# p! v- ~" c% s2 OJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},4 B8 ?) y, [' O% V+ a2 I+ ]( Y7 }
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
% S; F) Z- e7 K* i/ z- E5 a) p$ q, y' s0 c _6 M: Z! k0 D
- K: x: j% _( i) P) H) J/ l
' @# g! [& |2 gJun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.9 U& Y6 P6 @& P0 p: o( C4 `
Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)
* H9 w5 a) S. hJun 7 14:35:28 controller2 rabbitmq-server: BOOT FAILED
0 ~: T2 E2 L" z% g5 b4 L ^4 nJun 7 14:35:28 controller2 rabbitmq-server: ===========
0 b! ~$ C0 d0 N1 V6 Z/ Z. ?Jun 7 14:35:28 controller2 rabbitmq-server: Error description:
6 U4 u9 Z1 l* @; GJun 7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,
7 o1 p; D8 j2 z' ~5 H9 e2 b9 GJun 7 14:35:28 controller2 rabbitmq-server: {bad_return,9 d1 Y/ b- U! I6 I
Jun 7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},
5 a0 j+ _9 |4 r# DJun 7 14:35:28 controller2 rabbitmq-server: {'EXIT',
, u: R/ g: e9 gJun 7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,$ P- e2 k1 j, B" [
Jun 7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery, u5 f5 H" N, K5 w; L) r- {
Jun 7 14:35:28 controller2 rabbitmq-server: {badmatch,
: t( u3 c, [+ u R, r) Z; iJun 7 14:35:28 controller2 rabbitmq-server: {error,
2 h+ s3 _4 ?% A1 L% u2 CJun 7 14:35:28 controller2 rabbitmq-server: {{{badmatch,8 V: y' E- O* k% d3 g
Jun 7 14:35:28 controller2 rabbitmq-server: {error,/ w3 \3 u- s0 K/ l( _8 B6 `6 T
Jun 7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,! S* Q$ I, ?! R: S* W ?4 l
Jun 7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
2 n/ p' [' ^' p- Y8 R2 uJun 7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
! U) B( @9 G8 |: BJun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
# K" \8 j2 E3 X# l1 s- IJun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
# o! p0 C! C: E& ~! B* O- u# H6 y- C) F8 [3 r! R
Jun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]}," E3 j0 l2 g0 U) |$ @7 ]
Jun 7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},1 f+ Q* }5 P6 c4 ~# {4 K
Jun 7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
8 q8 |" j" u2 w, zJun 7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
2 p9 ?& c6 e: a1 c4 [* cJun 7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,: G2 R) N/ X# [0 t3 s2 K
Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
: L- l0 [- {7 G; e8 ~/ L3 K$ O/ ~( JJun 7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,; T+ f% c3 c+ B# m. u
Jun 7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}
1 ]4 w, a: G5 G% D' H9 vJun 7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):
& [+ Q- ~! q8 x6 e8 C! CJun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log1 a$ l3 X4 `0 U+ \4 ^- B
Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log9 R% i* h% K' Y$ e; \
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed.
# Y9 J$ b: n6 V9 gJun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running.
3 }% p9 f4 A0 G# k/ |Jun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)
5 P' H# t' B) D- N, B3 G! S2 A, {Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed.$ c; S7 W" W" y- K9 S2 n! F
7 k) s! D0 O( I, Z q- ~Jun 7 14:35:29 controller2 systemd: Started RabbitMQ broker.
$ u# l# _1 a3 X7 h! DJun 7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
* k4 }# y: t- I! n; f3 U/ qJun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)3 Z- ^7 m4 }5 t! J
Jun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false): D! E; J) \- y7 _- h P6 E( M
Jun 7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump/ |/ O* b: m! U% o3 O0 y7 \7 K7 r
Jun 7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()
! I; Y7 a. m' N4 n( H; xJun 7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
9 z8 m& H' R+ V$ b4 y; B# c. U$ ~Jun 7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...1 y# ^- P) I" l- f$ {% V5 W
Jun 7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
4 S- N- k5 c) fJun 7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS
6 @/ C) m9 }! X1 wJun 7 14:35:31 controller2 rabbitmqctl: ===========
3 z) w' g* f4 T( V/ G7 pJun 7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']* _& I! f' v3 k% Y# X
Jun 7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:' y8 @7 M9 j1 n
Jun 7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
! p5 ` T$ h" E8 U9 F8 W1 a3 v6 _Jun 7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
5 u+ y4 U& ] V- HJun 7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2
) i% q) U/ T/ d) dJun 7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node
9 q+ c7 g5 E3 I) L3 \Jun 7 14:35:31 controller2 rabbitmqctl: current node details:$ { ^! X7 L! d
Jun 7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2': n1 i- n% y6 |8 c9 X" ^
Jun 7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq9 Z q8 s; I$ [+ Z( M
Jun 7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==
6 X8 U& E* r7 S4 d' l2 |Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2
5 [/ k' |0 S7 q) S7 vJun 7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.
9 _8 o( @7 Q" w3 i. T# DJun 7 14:35:31 controller2 systemd: rabbitmq-server.service failed.
. {% j# E4 T" I, bJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out
! C) P0 i" f6 y* A- L# `# p/ {; oJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)7 a* k0 ^3 }/ ]0 s) K
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer6 C/ r7 q5 R6 k% D2 e& ]. C2 @
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:217 done2 J: v U, x k# d
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out0 i% v! J! z. R& U( @3 @
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)
* M) Z% Q5 P' @4 h6 J' b$ M( @Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
$ b6 K9 ^" G ]- @( VJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:217 done
3 U/ @7 W! P8 H. k, u1 sJun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent8 V, L, k, M! ]( Y
Jun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}3 B* A3 O2 V9 \4 `
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.
! L/ V* ~) s$ H m! d9 d* y: dJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)' h, |- s+ D# [1 @$ \5 V
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed.* B" f. D, Y5 {: Q! _. n& s
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.
7 w! m6 D! N r5 H" W9 sJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true)6 U$ v; L! X( }; i1 V2 u
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.+ S. _* |' O% l/ Y0 N6 A$ g7 x2 n
Jun 7 14:35:39 controller2 systemd: Starting RabbitMQ broker...
1 Q' ~* m* b4 D' _# i7 W* m' `Jun 7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
( R- u: w9 Y9 J4 [0 ]3 ^Jun 7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...
! Q4 i; y6 j8 F* S: \Jun 7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.4 X8 k& f5 m. {+ k1 p
Jun 7 14:35:41 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/* ]5 ~& N- ^8 M. ^
Jun 7 14:35:41 controller2 rabbitmq-server: ## ##
1 r9 W0 E' |! Z u# G( ^1 xJun 7 14:35:41 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log
3 s" L/ b8 ], g' o( f1 G$ KJun 7 14:35:41 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log' A$ l5 g, V% {
Jun 7 14:35:41 controller2 rabbitmq-server: ##########
. F" Q7 \; e2 F% tJun 7 14:35:41 controller2 rabbitmq-server: Starting broker...
1 l& J. V2 z; ?' ~1 _( C1 CJun 7 14:35:41 controller2 rabbitmq-server: BOOT FAILED2 r. z4 D0 U9 k: O
Jun 7 14:35:41 controller2 rabbitmq-server: ===========
8 U6 J0 n' d- Y; @/ s. L: c! GJun 7 14:35:41 controller2 rabbitmq-server: Error description:
* A3 m. |+ ?- i# P* G# S* ?. LJun 7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery," a' _2 h/ B' j, v
Jun 7 14:35:41 controller2 rabbitmq-server: {badmatch,; f0 O7 n: e6 o6 V0 b
Jun 7 14:35:41 controller2 rabbitmq-server: {error,. S; U2 d0 B& t( C* c- o2 e
Jun 7 14:35:41 controller2 rabbitmq-server: {{{badmatch,
* O2 Y" [6 B5 e4 M' ] V8 xJun 7 14:35:41 controller2 rabbitmq-server: {error,
# g7 j# H) v* C# _Jun 7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file,$ t* Y/ } a2 }" U1 r& m" O
Jun 7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},1 {9 \; T: U) ^( R0 X" Q, G
Jun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,/ z( f9 t5 @2 e5 P, A- n( P
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},% A; C0 K/ C+ x. M) F
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,7 V7 W9 I) u p" T" e- _/ I
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},: x* ]: i5 n' x
Jun 7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},' R: g; D# j* {
Jun 7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,. v! t* B8 c+ N+ k3 r# Q m$ D' }
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
( l" `: W6 n, [$ v, R4 ZJun 7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,0 F3 K# P/ g/ e" V9 X# Q1 ]# \
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},$ p+ o& d/ i1 `
Jun 7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,
& | @8 f( Z$ t, Q1 {, {) }6 cJun 7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}5 j# |$ r: U' Q: ~
Jun 7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):8 ^, L# K0 J/ `+ k
Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
/ Z% {# T3 _) E9 j, [( _Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
/ C0 y' A8 b+ CJun 7 14:35:41 controller2 rabbitmq-server: Stack trace:
: l( }) K9 T' k+ ]4 hJun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,0 t# u* W- k4 h& J
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},
" i4 B; r' L2 k$ x. f" X2 pJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1," _3 T9 A0 d" X3 R9 Q0 F
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
3 ^6 |& {2 B Y, `+ j8 [Jun 7 14:35:41 controller2 rabbitmq-server: {line,402}]},- D+ N7 h4 L' J0 \0 t
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},4 c" i: m4 p# w& w( ?4 l0 W# ^! w
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},
- A4 C+ C0 R+ D! k' ^; ^0 C' Q/ xJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},; u, |/ e3 V O5 ]( M; ^
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
, ~% w# k6 i* P+ Y; v& v* rJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
% ?, v( X. E% ZJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
6 D* z$ \- X& Y N+ s. V( GJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]2 Z5 Y* A; s# A5 @
Jun 7 14:35:42 controller2 rabbitmq-server: BOOT FAILED
+ h4 o+ C i. w% t2 fJun 7 14:35:42 controller2 rabbitmq-server: ===========
0 ~* k, O" z7 f: Q$ D) ?Jun 7 14:35:42 controller2 rabbitmq-server: Error description:: D9 O" |* o& e
Jun 7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,
, ~7 Y Z7 v( L, RJun 7 14:35:42 controller2 rabbitmq-server: {bad_return,
7 @7 Q, b9 }/ T8 KJun 7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},5 X+ l5 u* a! C
Jun 7 14:35:42 controller2 rabbitmq-server: {'EXIT',3 j! |- H8 b7 \1 w& v
Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,
3 y7 b2 A* ]1 k0 I: WJun 7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,
/ n) Q) l0 e }5 u Y) `7 JJun 7 14:35:42 controller2 rabbitmq-server: {badmatch,
$ m2 @) Y R7 g6 o3 ~* e1 FJun 7 14:35:42 controller2 rabbitmq-server: {error,1 O% R( P2 g! \' A0 }/ ~
Jun 7 14:35:42 controller2 rabbitmq-server: {{{badmatch,6 D* H8 F' b' I' H
Jun 7 14:35:42 controller2 rabbitmq-server: {error,
6 k) F5 |2 g9 m0 R/ p! W/ MJun 7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,
6 k& `! C) K7 v8 c1 S7 f% M' V/ nJun 7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
3 N0 M0 J( s3 |6 n2 S9 WJun 7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,% i9 s8 X7 T+ V1 C8 ]
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
+ F$ P( l+ B) ^1 d7 d/ d2 C x7 DJun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
5 T1 o! l+ X0 r) ^: N& K6 H: xJun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
d+ k% z/ m/ [% z- NJun 7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},# H, c8 s4 B0 }
Jun 7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,* J6 d0 ?8 x- i7 w8 ~4 N! N! t
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
, W, l T% i: l6 oJun 7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
/ F; i: t3 o) @Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},3 t! w) {; P0 j( o: Z) g: N8 }9 Q
Jun 7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker,
( ^5 z1 S% I4 p* h! @Jun 7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}/ z( u/ n( ]8 r: r/ g+ u
Jun 7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):
% G* E* a3 }# g6 E: a4 CJun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log! W3 h" ^+ k p! z5 G) b6 g
Jun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
! |' \3 S7 K" Y3 F, I; V) tJun 7 14:35:43 controller2 systemd: Started RabbitMQ broker.2 U6 e; T0 J! m5 N$ W% X
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)
# K* q$ `0 S9 p) z1 h9 b; J' NJun 7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
0 x- L; I& B4 L' d2 qJun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)3 E0 [( X9 I( h. a9 K" Y J) S2 a
Jun 7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump- q; _1 S' f, K. s- T7 u
Jun 7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()
% _& |! b* b! r4 ]+ o& oJun 7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
( {$ V" T6 }, w; KJun 7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...8 m0 n' O! `: T) ^- I/ w2 M- C* Q* B
Jun 7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown
; c* A- \% j# ^5 C5 sJun 7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS0 B, K. B/ a& Z1 w
Jun 7 14:35:45 controller2 rabbitmqctl: ===========- N, D* i4 ^ {" p* B, v
Jun 7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2'] q4 R) J# z9 {% ?
Jun 7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:% m( K- ?6 k% o
Jun 7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
( Y3 w# S( y3 ]& V+ BJun 7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all) |5 n7 J; g0 [8 l, x5 s
Jun 7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2
B; _; F5 {) r, f+ E3 K1 l3 q4 oJun 7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node
; m" ~* H5 I- p1 GJun 7 14:35:45 controller2 rabbitmqctl: current node details:1 O7 e+ p- v. J! L- p+ ^5 n: |
Jun 7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'* l9 } R. J# W; j+ O% I
Jun 7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq7 Z6 R2 w: h6 |# X
Jun 7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==4 }" f1 c# ]) u+ d1 @9 o5 P
Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=26 R# a% q4 G2 b* q* P, d& s8 Z
Jun 7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.- n! B2 [/ L; g8 x9 }: R
Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service failed.( v2 l7 h0 T6 b- J x
Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
5 \8 x0 m5 v) T4 ~! {Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:20444521851 R' R" D1 d) H `* M; ]
Jun 7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}
$ b# N2 g$ b& eJun 7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5
. m4 u/ _5 e1 e, h# KJun 7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed., H3 U4 t. C* s+ R
Jun 7 14:35:53 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)8 @8 ~" U' X. n6 L$ w
Jun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed., e9 ]$ I0 ]: s$ Z7 V2 d1 z9 y
Jun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.( A z& D3 @. \: p) _ J
Jun 7 14:35:54 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true), ~' h3 X; b: K$ O
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out
! i4 ~+ _$ t) |+ l* jJun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)( B9 x: T, x5 Z. [1 r6 i
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
8 i0 V& I9 w" }% ]6 R4 _3 F0 y, pJun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:217 done
i% H( a5 f9 }; a1 w1 I
% e" f: o; e& |0 L: h9 i3 o8 c9 U% o$ z) T. r2 e7 B; I
Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
$ r( o8 t$ t# {% q$ ~Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:20444524245 ~5 y. b4 A. o5 K5 o0 N
" M* q, @, {$ J" R+ J0 s' F
" \, ^- F# |* @ Q# |/ g
|
|