- 积分
- 16840
在线时间 小时
最后登录1970-1-1
|
马上注册,结交更多好友,享用更多功能,让你轻松玩转社区。
您需要 登录 才可以下载或查看,没有账号?开始注册
x
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log2 e& m/ B0 \+ u1 n9 Y
Jun 7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
r4 `: \. i& d( N8 \" T1 HJun 7 14:35:18 controller2 systemd: Started RabbitMQ broker.' F# L+ [2 q! f$ d
Jun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)
2 \" k/ ~9 h) p( kJun 7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
& _2 I8 G7 y' d9 c1 G$ X! r* lJun 7 14:35:18 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false): D/ Y) T! a5 S: c. d5 q
Jun 7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}
/ E+ s. z, O' q5 n4 ?Jun 7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
, E" w# y0 t7 v) w1 yJun 7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()1 H; g/ g" a% T: h% \0 ~$ G3 V
Jun 7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE9 c" ^/ E* `1 C& e5 S& K0 k
Jun 7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
, v/ {: m, Y1 J# qJun 7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown3 s( q6 z( D( i4 k; j
Jun 7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS
( P! |) j" B& N% a; mJun 7 14:35:20 controller2 rabbitmqctl: ===========
V( u) C9 q% H- E1 qJun 7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']; z4 `1 S ~8 e" @4 E, @
Jun 7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:
# i- p; |7 W/ p7 AJun 7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller23 O: S7 J9 b T& Y% P! R9 j0 I1 ~
Jun 7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
' z( u- m, s+ uJun 7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
% D. O/ ~( u8 L5 w7 m gJun 7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node
. Y5 `# }& d9 v, \* a; uJun 7 14:35:20 controller2 rabbitmqctl: current node details:7 t2 z0 x# g, m/ u) ~6 S7 p
Jun 7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2'# e) l3 v5 b* x2 D" ^' z& i% A. B- V
Jun 7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq0 V1 [. f0 c# V1 X) I( ~; o. \
Jun 7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==$ M3 }* R& |2 q. h
Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=26 U: O; o% o0 q: F" e. g/ V
Jun 7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.6 }0 u! f. i p) c
Jun 7 14:35:20 controller2 systemd: rabbitmq-server.service failed.9 Y \' ]/ ~( k
: Z- r8 O+ C. ?7 m. K6 a4 k" k
1 }5 C( C- s4 ^( U: `( C% d2 \
% c% i1 d* ~1 U' s6 b. pJun 7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5
8 A- Z+ A$ b2 S' j. |6 RJun 7 14:35:25 controller2 systemd: Starting RabbitMQ broker...& S$ B8 S: m1 j3 h7 N
Jun 7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984
5 C) s, T- L: T. t8 UJun 7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984% \* o/ |( T, n# N3 N" e7 m
Jun 7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...; O6 n% E" j0 O# z1 m; G
Jun 7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...
+ O! e7 E* F$ H: ^* T# |$ v5 B* CJun 7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.; d4 G. o- A2 E4 F1 {$ @. X# a
Jun 7 14:35:27 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/6 A; ~/ \, {- l& @3 {7 ^
Jun 7 14:35:27 controller2 rabbitmq-server: ## ##0 h. n& [( D) p" P+ i/ \0 q
Jun 7 14:35:27 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log( H. w- ]0 U7 X! S& Q
Jun 7 14:35:27 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log) a' Z/ Z3 V" X3 n+ t
Jun 7 14:35:27 controller2 rabbitmq-server: ##########! Y- @: }6 e: F& r, q
Jun 7 14:35:27 controller2 rabbitmq-server: Starting broker...
. N' ]1 Y# W* ]( u6 PJun 7 14:35:27 controller2 rabbitmq-server: BOOT FAILED
& e [1 R& q4 C% ^; |; oJun 7 14:35:27 controller2 rabbitmq-server: ===========5 U6 s1 p1 u. V4 V0 l T% r
Jun 7 14:35:27 controller2 rabbitmq-server: Error description:$ n5 ]1 B5 x- D# C- F
Jun 7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,
: @, M3 _* ^% B1 A* BJun 7 14:35:27 controller2 rabbitmq-server: {badmatch,
, o) P* ]. Z" e. n- k3 C! eJun 7 14:35:27 controller2 rabbitmq-server: {error,0 j5 n9 n+ q; h* \
Jun 7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
+ o/ `3 z8 h6 a7 [" J" C+ ?; `Jun 7 14:35:27 controller2 rabbitmq-server: {error, i1 W: a7 r; [5 {% @
Jun 7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,0 h! D& c% a. l2 W7 _; Z
Jun 7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
) ^$ q7 X2 _' O* AJun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,, Z. u) f3 i1 M6 V+ y+ P
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},, R: B# d9 F* o4 ~. [# k% c- k* o
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
0 k7 a) Q" ~ ]' r" I0 dJun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
. P7 P3 _" p! `Jun 7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
, T& n2 V/ m& T; uJun 7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
0 U0 u% _& D0 T& p4 u j' [' hJun 7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
. C! l7 Q) K" dJun 7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,, a$ @% U) Y- C2 [- U
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
/ C& J- F% J+ G1 F+ h- u8 eJun 7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,
, I% L' |( [1 ^- c0 P2 uJun 7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}* {4 y, I1 q/ f% N6 q
Jun 7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):
6 `8 T; r4 C) n3 lJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
$ X7 X3 y1 G: d7 z6 ? ^. UJun 7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log( k3 e& K$ ]: |4 A
Jun 7 14:35:27 controller2 rabbitmq-server: Stack trace:
; v* K6 b0 ^9 Q+ \% p/ h5 LJun 7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,) k' s' l; e- N( N
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},. }/ c5 b/ ?5 v4 V, o) p6 n
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1," H9 U7 X- k0 j+ `) N
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},: x+ L$ \, R! |7 s' `$ ?
Jun 7 14:35:27 controller2 rabbitmq-server: {line,402}]},3 R' x8 D7 L( j* k2 J7 ^. W, {
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},2 {& U/ Y0 G) ~3 s% k
Jun 7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},
h0 o* w4 P: V- L) H8 dJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},
! U6 t4 z5 G8 s7 p& M, w3 g7 SJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
1 j5 f- k/ Z+ U+ d. TJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,$ z, P$ f8 G8 o- }
Jun 7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
2 L7 O F4 h/ ^8 _9 z& x0 i% C( fJun 7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
( K7 p& X. S* |9 L! | |8 q( Q+ u$ O+ s7 K" r* `) K5 t
7 {/ v, i4 P- s; a0 z3 v
# X/ [+ j8 T4 T& X' e# w0 E
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.
( ?# k5 K+ _3 [! IJun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)& G, x6 x( m! t0 V4 q. b7 R, d
Jun 7 14:35:28 controller2 rabbitmq-server: BOOT FAILED2 n3 Z% N7 R( S% l7 _
Jun 7 14:35:28 controller2 rabbitmq-server: ===========2 k, x: c# |: _! w
Jun 7 14:35:28 controller2 rabbitmq-server: Error description:# s- k: i1 J. ]: }; u
Jun 7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,
* B( L7 P3 v1 z0 q$ yJun 7 14:35:28 controller2 rabbitmq-server: {bad_return,
4 V* N- j& i$ n% l& L# c/ |Jun 7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},) D+ x; E6 d6 A
Jun 7 14:35:28 controller2 rabbitmq-server: {'EXIT',
~) _% i" P* lJun 7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,: Z0 u$ Q2 g6 A' V: n) O
Jun 7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery,
5 a: Q/ x9 l% DJun 7 14:35:28 controller2 rabbitmq-server: {badmatch,
' w! Q$ n4 o; U* vJun 7 14:35:28 controller2 rabbitmq-server: {error,/ R. ^! u# T- {6 I
Jun 7 14:35:28 controller2 rabbitmq-server: {{{badmatch,
6 `, c. F3 u3 T; w- ^Jun 7 14:35:28 controller2 rabbitmq-server: {error,( \, Y3 s# H; s- k$ U1 f* D5 J
Jun 7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,
- e+ W& i# w8 }. j. x: O' lJun 7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
6 s; G" E c. S) ?5 bJun 7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
8 y; H- I& E/ `1 ^6 jJun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
3 t/ t. B0 `7 h- [Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,6 \# n5 ]3 @) U0 W
" J) N! e9 ]1 EJun 7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
2 x( W$ {5 y2 K) _3 k: f0 t XJun 7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]}," |6 A' k5 X/ ^. ?' F
Jun 7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
, A1 Z' j% K0 JJun 7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},) Y/ O. ] I l' t: X& |2 j# \' ?
Jun 7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
% s/ O7 D2 |( _Jun 7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},% h& [/ r' M1 `/ Z* I
Jun 7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,, f. k/ e3 S- G, P2 m( s1 i
Jun 7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}
9 b) s u( j9 j% D4 A" K% y3 K$ tJun 7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):6 b3 S: J3 Q5 \6 c- m4 q3 V
Jun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
+ J/ b4 M% G3 p) c- e# l7 aJun 7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log! `+ w' h" g6 Z7 D& M* ]
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed.
% I. z" H- p4 ~( x C& I9 `Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running.
- k8 j5 Z7 r* E5 w4 I% lJun 7 14:35:28 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)$ c. k, H% S* y8 D; ~: ?' g6 I! J2 F
Jun 7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed.
% a3 x5 |2 U" C9 Z# ^) X6 ~
, m, J, _2 A. T& @% kJun 7 14:35:29 controller2 systemd: Started RabbitMQ broker.7 c# R, |) w v2 H
Jun 7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}) {6 g* Q& U& x) _/ ^3 R/ L
Jun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)
@' v) i. ]- f, \Jun 7 14:35:29 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false)* C$ f5 Q* ?" S9 E. h& [% J& ]
Jun 7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump) U3 o6 F, L* _' j- ^+ Q
Jun 7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()& t/ B7 P! f5 u* |
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
# g/ |6 h1 G5 t% C5 ^Jun 7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
" ~" o+ Z4 h, i: X$ P8 [Jun 7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown8 P: Q7 |, ~+ T: i$ N3 V% a6 r0 w
Jun 7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS" `# R; C7 k8 ~( c+ ?
Jun 7 14:35:31 controller2 rabbitmqctl: ===========
# ~4 _, T( T8 XJun 7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']% X1 J0 [. e) Q- F- ]6 C2 v$ z
Jun 7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:& M2 ^% m. t$ y1 _4 t4 y. `
Jun 7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
" J. u9 I6 _- U6 TJun 7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all# ]' n9 v4 I" x
Jun 7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2
, q# E) K# @" j" ]& ]2 M( FJun 7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node- r. f3 Z _$ u3 s0 X6 X% a
Jun 7 14:35:31 controller2 rabbitmqctl: current node details:
' R9 V0 G6 i) B6 S) z5 kJun 7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2'+ ~% x" s0 c1 D. i" K8 K
Jun 7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq
( y/ a# ^- Y2 u0 F" h9 }. MJun 7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==1 W) _+ [' M u& A
Jun 7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=25 o( q" Z* a. Q! U3 ~
Jun 7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.
6 K1 d- W c+ P% Z gJun 7 14:35:31 controller2 systemd: rabbitmq-server.service failed.
: R9 ?8 j' L. ?" [Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out, R9 u: T2 A" L8 B
Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)
) e' h' ~, c1 c( M5 P+ C. S; aJun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer
* {+ e0 w$ u5 Z) h+ a2 @% |Jun 7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800 INFO [publisher] pipeline/retry.go:217 done( z3 }8 q/ k6 [% G! E
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out
% O; ]: F- @+ V2 L. z$ O8 eJun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)3 f# b) A% L+ G. D
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer* L8 @0 [1 n1 X
Jun 7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800 INFO [publisher] pipeline/retry.go:217 done% L. }# l4 V, U# @' s
Jun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent' d# d6 T- S, o: |
Jun 7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}
* R' A# x$ t1 h2 e4 H+ VJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.% A) q w' {8 g: {3 P; G( k. V
Jun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)4 |; a- m) `1 `0 Y$ K
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed.
% G2 t6 [- O% T& o! [+ CJun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.
* G4 O& n* W0 C# u! q' oJun 7 14:35:39 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true) V7 D# t8 @: Z2 G
Jun 7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.) U8 T8 @3 U; B% ^# ?; D
Jun 7 14:35:39 controller2 systemd: Starting RabbitMQ broker...( f2 O# {! B1 g5 `! u# ]6 d% A
Jun 7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
( h5 E! f: o7 G2 G- F7 h9 xJun 7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...9 k) a. ^5 Q5 Q" I
Jun 7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.9 a4 k0 l( O* t. |
Jun 7 14:35:41 controller2 rabbitmq-server: ## ## Licensed under the MPL. See http://www.rabbitmq.com/" \# Y* Q2 K5 N! P3 q( B% `
Jun 7 14:35:41 controller2 rabbitmq-server: ## ##& s7 K2 j! j, a* R" Y' y4 J0 }
Jun 7 14:35:41 controller2 rabbitmq-server: ########## Logs: /var/log/rabbitmq/rabbit@controller2.log
" @7 v4 t; u- k5 S# Y$ l" nJun 7 14:35:41 controller2 rabbitmq-server: ###### ## /var/log/rabbitmq/rabbit@controller2-sasl.log* J i: \- Y' b2 P
Jun 7 14:35:41 controller2 rabbitmq-server: ##########
4 U# v: z. x- _. D% A6 v/ s5 qJun 7 14:35:41 controller2 rabbitmq-server: Starting broker...
6 i+ w/ k, C$ K3 v$ |# d& |6 B; RJun 7 14:35:41 controller2 rabbitmq-server: BOOT FAILED! R& E5 z: r: s' x$ y9 z `, F
Jun 7 14:35:41 controller2 rabbitmq-server: ===========
# D9 y2 Z' ^% l+ }3 _5 v% a' r8 NJun 7 14:35:41 controller2 rabbitmq-server: Error description:; c( B3 F6 X0 g3 C3 t& q+ J9 `
Jun 7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery,
) P6 J* Y" E. {% ~9 h1 L+ VJun 7 14:35:41 controller2 rabbitmq-server: {badmatch,
; v/ _# p) G8 O" tJun 7 14:35:41 controller2 rabbitmq-server: {error,& @4 @# |9 n" O7 t1 N6 ]. d9 y9 L
Jun 7 14:35:41 controller2 rabbitmq-server: {{{badmatch,; h- A* p: | B# a) X' b
Jun 7 14:35:41 controller2 rabbitmq-server: {error,! @; z7 _, U3 |9 z5 Q8 C" V/ I# w \
Jun 7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file,( Z7 N( q- I1 b) F% r: l- P# a
Jun 7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
$ C% V2 T* x' R! D9 c7 t7 a+ D0 YJun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,$ u8 S" g$ r% \# p* ~& O6 j! b3 O! o( E
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
2 o" z8 l5 m' f. G% F( Q+ o! lJun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,: N4 ^' E c1 g! @% G8 ]* a
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
5 L$ K( K3 g0 n [: k5 ?Jun 7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},6 v" D" t% R. F0 D: q: C7 R
Jun 7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,7 ?' k! Y. @/ q) [# E
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
, o* n* g) w8 N) ]; c2 tJun 7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,. Z+ y+ {# x- X* ]- p
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},5 X! |8 U! `; L& w/ o
Jun 7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,: b& _4 o# W) M& ]* [
Jun 7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}
b5 e6 e7 x. I9 J, J( \Jun 7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):/ D7 D$ Z# o1 P. D
Jun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
; E1 G7 S' r% P: s& HJun 7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
5 E' a* Y* M; U NJun 7 14:35:41 controller2 rabbitmq-server: Stack trace:
& @3 Y& S& N M7 {, }1 K; nJun 7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,$ @' }* D$ n( v$ N0 x# i2 V
Jun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},4 @9 r% F h$ g- ~7 X0 R
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
" x% O2 ]+ ^: p: QJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
- S* N) T( F: k, y5 pJun 7 14:35:41 controller2 rabbitmq-server: {line,402}]},
* j! z: q" S$ n1 N, ?Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]}," n9 m4 C. K5 ^5 U- \' b! O% K
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},0 o8 I# o, w0 ?& I' t" y: ^
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},7 o6 s! n3 e/ S9 X9 n% \! n
Jun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
( S$ T8 S5 d' f! H, Z: a; ^& fJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
: x6 o. c e0 L% R j) y6 X8 rJun 7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
5 ~9 m, T8 `6 t& u: z7 j. I% zJun 7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]( i0 B; E. T" y0 H/ T( t$ t& P
Jun 7 14:35:42 controller2 rabbitmq-server: BOOT FAILED
- R5 R/ H( ~. g3 J5 I( F( h3 bJun 7 14:35:42 controller2 rabbitmq-server: ===========
9 ~( \; ^3 @4 G& }, N5 ^% jJun 7 14:35:42 controller2 rabbitmq-server: Error description:
( W' V: w4 ~/ K/ BJun 7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,' u6 [; o0 n6 Z) y+ g# k
Jun 7 14:35:42 controller2 rabbitmq-server: {bad_return,' j, G8 _# e. k4 g1 W
Jun 7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},
v, i5 b2 g- N% YJun 7 14:35:42 controller2 rabbitmq-server: {'EXIT',
* v/ _6 m4 V: A4 f/ n4 T7 [& vJun 7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,. \% ~6 `* M0 a; {# @
Jun 7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,
0 m# V6 C# F0 _1 ^Jun 7 14:35:42 controller2 rabbitmq-server: {badmatch,
8 s4 `3 n" R* z/ v* D7 Y/ nJun 7 14:35:42 controller2 rabbitmq-server: {error,% O z% ^3 [* K
Jun 7 14:35:42 controller2 rabbitmq-server: {{{badmatch,
0 X) S7 C8 `3 X) m5 eJun 7 14:35:42 controller2 rabbitmq-server: {error,2 a( w8 b, v1 R- X# J7 [) f
Jun 7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,5 h# B/ \: ^% j9 a
Jun 7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
# h4 P5 u' \( u; kJun 7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
8 \& j, g/ R& k9 B' p1 ?, qJun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
; [! a% X, J4 x# ~9 E3 UJun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,2 _3 {2 v2 ?$ ?" X+ t
Jun 7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
8 f w3 C! c) m$ {1 }; d! j- Y& UJun 7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
/ o; {8 k" C5 W ^3 H0 BJun 7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
4 u8 I$ \8 I1 k/ B5 kJun 7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
- U( o" W' j+ |+ hJun 7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
6 Z9 l' ~1 Y! d* \Jun 7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
. I0 B; m. d& r) CJun 7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker,
. z. t( g' H& u) F, `Jun 7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}0 @" s8 E* j1 T
Jun 7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):
) \6 I/ G5 D: _9 I5 W2 D) fJun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
3 A8 s; V% l! P; d! @) bJun 7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log; J N% d3 C. B* V, g
Jun 7 14:35:43 controller2 systemd: Started RabbitMQ broker.( Y# x% D# H/ t2 J
Jun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)4 l+ l8 Y7 }- r
Jun 7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
% x$ Y% a. \+ AJun 7 14:35:43 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)
! u# {, N. g! B& s2 r. r) O5 p7 |2 qJun 7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump' D1 L$ l | C# U$ s1 G% P
Jun 7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()
0 T; i. ?7 M' w7 HJun 7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE5 K y4 F3 ^# e! | b+ d' X
Jun 7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' .../ ]& V1 U& V C, j7 |' p( N8 a8 t
Jun 7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown3 L! {7 R# H7 M6 E5 y
Jun 7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS# H( C4 w( c3 Q7 |1 Z# [
Jun 7 14:35:45 controller2 rabbitmqctl: ===========2 y! T# L, Q& W8 J
Jun 7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']
+ S/ J) n6 L9 e/ mJun 7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:- q: r1 s) f0 A0 c, J; D8 C
Jun 7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2- y; i! r) _" v8 K
Jun 7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all0 u! [ {# R3 ^3 t
Jun 7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2
% k& }7 h" Z: ?( bJun 7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node
6 _ z0 P; l2 ]2 J; b$ K0 bJun 7 14:35:45 controller2 rabbitmqctl: current node details:) N, S$ J' M6 V0 Y# F6 U- O8 Y6 {
Jun 7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'+ }/ y" [$ A( G' S1 j
Jun 7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq0 d/ V8 s& P+ W/ ^0 F( t
Jun 7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==( W- F; \1 L% x
Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2( n/ p9 q h# g* a
Jun 7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.
0 A4 I0 C- s. k x0 u+ {Jun 7 14:35:45 controller2 systemd: rabbitmq-server.service failed.
7 X4 Y+ @" A' Q1 \Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
! n5 \' q5 p0 ?Jun 7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
# N# p1 S* E) o! |' ^, xJun 7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}
9 O) d* g3 q b+ Q% R4 L' OJun 7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5$ u) r7 {( }6 ]. [% j$ z
Jun 7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed.
, }2 q2 R4 F( X1 [1 YJun 7 14:35:53 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)
6 F7 h9 a, V+ z; R' X9 v) o1 vJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed.
y. S9 W/ c& f7 UJun 7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.
A! | T) O2 l4 z6 p$ }Jun 7 14:35:54 controller2 crmd[6475]: notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true)3 s/ m! @! D4 t0 B( {
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out- c8 d( ^, o1 _3 i0 I8 e0 ~5 D$ o
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher_pipeline_output] pipeline/output.go:145 Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)0 F' E( N: W1 ~8 N5 H5 b( t- h
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:213 retryer: send wait signal to consumer3 K# y5 b3 i# H/ X4 @' D6 f
Jun 7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800 INFO [publisher] pipeline/retry.go:217 done
a2 \. v9 I( V" F; a6 {/ N; C v4 |8 \* m3 x( j! u. X& U w
# a! k. S9 G Q' V0 M, |
Jun 7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
+ _- y$ P. g' W7 r9 E2 r6 XJun 7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
" U" `4 K5 c U0 s' ^, ^' I, T0 v4 _& h' g" k. R
& F Z0 ]9 o4 j. q0 c& z! v6 O |
|