易陆发现互联网技术论坛

 找回密码
 开始注册
查看: 8|回复: 0
收起左侧

notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown erro

[复制链接]
发表于 2024-6-7 15:00:19 | 显示全部楼层 |阅读模式

马上注册,结交更多好友,享用更多功能,让你轻松玩转社区。

您需要 登录 才可以下载或查看,没有账号?开始注册

x
Jun  7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log2 e& m/ B0 \+ u1 n9 Y
Jun  7 14:35:17 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
  r4 `: \. i& d( N8 \" T1 HJun  7 14:35:18 controller2 systemd: Started RabbitMQ broker.' F# L+ [2 q! f$ d
Jun  7 14:35:18 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548943, rc=0, cib-update=594832, confirmed=true)
2 \" k/ ~9 h) p( kJun  7 14:35:18 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
& _2 I8 G7 y' d9 c1 G$ X! r* lJun  7 14:35:18 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548944, rc=0, cib-update=594833, confirmed=false): D/ Y) T! a5 S: c. d5 q
Jun  7 14:35:19 controller2 filebeat: 2024-06-07T14:35:19.300+0800        INFO        [monitoring]        log/log.go:145        Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890090,"time":{"ms":4}},"total":{"ticks":2986430,"time":{"ms":11},"value":2986430},"user":{"ticks":2096340,"time":{"ms":7}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384740183}},"memstats":{"gc_next":33883984,"memory_alloc":18558592,"memory_total":69310713440},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.47,"15":2.54,"5":2.58,"norm":{"1":0.0618,"15":0.0635,"5":0.0645}}}}}}
/ E+ s. z, O' q5 n4 ?Jun  7 14:35:19 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump
, E" w# y0 t7 v) w1 yJun  7 14:35:19 controller2 rabbitmq-server: init terminating in do_boot ()1 H; g/ g" a% T: h% \0 ~$ G3 V
Jun  7 14:35:19 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE9 c" ^/ E* `1 C& e5 S& K0 k
Jun  7 14:35:20 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
, v/ {: m, Y1 J# qJun  7 14:35:20 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown3 s( q6 z( D( i4 k; j
Jun  7 14:35:20 controller2 rabbitmqctl: DIAGNOSTICS
( P! |) j" B& N% a; mJun  7 14:35:20 controller2 rabbitmqctl: ===========
  V( u) C9 q% H- E1 qJun  7 14:35:20 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']; z4 `1 S  ~8 e" @4 E, @
Jun  7 14:35:20 controller2 rabbitmqctl: rabbit@controller2:
# i- p; |7 W/ p7 AJun  7 14:35:20 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller23 O: S7 J9 b  T& Y% P! R9 j0 I1 ~
Jun  7 14:35:20 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all
' z( u- m, s+ uJun  7 14:35:20 controller2 rabbitmqctl: no other nodes on controller2
% D. O/ ~( u8 L5 w7 m  gJun  7 14:35:20 controller2 rabbitmqctl: * suggestion: start the node
. Y5 `# }& d9 v, \* a; uJun  7 14:35:20 controller2 rabbitmqctl: current node details:7 t2 z0 x# g, m/ u) ~6 S7 p
Jun  7 14:35:20 controller2 rabbitmqctl: - node name: 'rabbitmqctl-19643@controller2'# e) l3 v5 b* x2 D" ^' z& i% A. B- V
Jun  7 14:35:20 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq0 V1 [. f0 c# V1 X) I( ~; o. \
Jun  7 14:35:20 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==$ M3 }* R& |2 q. h
Jun  7 14:35:20 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=26 U: O; o% o0 q: F" e. g/ V
Jun  7 14:35:20 controller2 systemd: Unit rabbitmq-server.service entered failed state.6 }0 u! f. i  p) c
Jun  7 14:35:20 controller2 systemd: rabbitmq-server.service failed.9 Y  \' ]/ ~( k

: Z- r8 O+ C. ?7 m. K6 a4 k" k
1 }5 C( C- s4 ^( U: `( C% d2 \
% c% i1 d* ~1 U' s6 b. pJun  7 14:35:23 controller2 dhcpd: isc-dhcpd-4.2.5
8 A- Z+ A$ b2 S' j. |6 RJun  7 14:35:25 controller2 systemd: Starting RabbitMQ broker...& S$ B8 S: m1 j3 h7 N
Jun  7 14:35:25 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984
5 C) s, T- L: T. t8 UJun  7 14:35:25 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044451984% \* o/ |( T, n# N3 N" e7 m
Jun  7 14:35:26 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...; O6 n% E" j0 O# z1 m; G
Jun  7 14:35:26 controller2 rabbitmqctl: pid is 20016 ...
+ O! e7 E* F$ H: ^* T# |$ v5 B* CJun  7 14:35:27 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.; d4 G. o- A2 E4 F1 {$ @. X# a
Jun  7 14:35:27 controller2 rabbitmq-server: ##  ##      Licensed under the MPL.  See http://www.rabbitmq.com/6 A; ~/ \, {- l& @3 {7 ^
Jun  7 14:35:27 controller2 rabbitmq-server: ##  ##0 h. n& [( D) p" P+ i/ \0 q
Jun  7 14:35:27 controller2 rabbitmq-server: ##########  Logs: /var/log/rabbitmq/rabbit@controller2.log( H. w- ]0 U7 X! S& Q
Jun  7 14:35:27 controller2 rabbitmq-server: ######  ##        /var/log/rabbitmq/rabbit@controller2-sasl.log) a' Z/ Z3 V" X3 n+ t
Jun  7 14:35:27 controller2 rabbitmq-server: ##########! Y- @: }6 e: F& r, q
Jun  7 14:35:27 controller2 rabbitmq-server: Starting broker...
. N' ]1 Y# W* ]( u6 PJun  7 14:35:27 controller2 rabbitmq-server: BOOT FAILED
& e  [1 R& q4 C% ^; |; oJun  7 14:35:27 controller2 rabbitmq-server: ===========5 U6 s1 p1 u. V4 V0 l  T% r
Jun  7 14:35:27 controller2 rabbitmq-server: Error description:$ n5 ]1 B5 x- D# C- F
Jun  7 14:35:27 controller2 rabbitmq-server: {boot_step,recovery,
: @, M3 _* ^% B1 A* BJun  7 14:35:27 controller2 rabbitmq-server: {badmatch,
, o) P* ]. Z" e. n- k3 C! eJun  7 14:35:27 controller2 rabbitmq-server: {error,0 j5 n9 n+ q; h* \
Jun  7 14:35:27 controller2 rabbitmq-server: {{{badmatch,
+ o/ `3 z8 h6 a7 [" J" C+ ?; `Jun  7 14:35:27 controller2 rabbitmq-server: {error,  i1 W: a7 r; [5 {% @
Jun  7 14:35:27 controller2 rabbitmq-server: {not_a_dets_file,0 h! D& c% a. l2 W7 _; Z
Jun  7 14:35:27 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
) ^$ q7 X2 _' O* AJun  7 14:35:27 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,, Z. u) f3 i1 M6 V+ y+ P
Jun  7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},, R: B# d9 F* o4 ~. [# k% c- k* o
Jun  7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,
0 k7 a) Q" ~  ]' r" I0 dJun  7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
. P7 P3 _" p! `Jun  7 14:35:27 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
, T& n2 V/ m& T; uJun  7 14:35:27 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
0 U0 u% _& D0 T& p4 u  j' [' hJun  7 14:35:27 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
. C! l7 Q) K" dJun  7 14:35:27 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,, a$ @% U) Y- C2 [- U
Jun  7 14:35:27 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
/ C& J- F% J+ G1 F+ h- u8 eJun  7 14:35:27 controller2 rabbitmq-server: transient,4294967295,worker,
, I% L' |( [1 ^- c0 P2 uJun  7 14:35:27 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}* {4 y, I1 q/ f% N6 q
Jun  7 14:35:27 controller2 rabbitmq-server: Log files (may contain more information):
6 `8 T; r4 C) n3 lJun  7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
$ X7 X3 y1 G: d7 z6 ?  ^. UJun  7 14:35:27 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log( k3 e& K$ ]: |4 A
Jun  7 14:35:27 controller2 rabbitmq-server: Stack trace:
; v* K6 b0 ^9 Q+ \% p/ h5 LJun  7 14:35:27 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,) k' s' l; e- N( N
Jun  7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},. }/ c5 b/ ?5 v4 V, o) p6 n
Jun  7 14:35:27 controller2 rabbitmq-server: {rabbit_variable_queue,start,1," H9 U7 X- k0 j+ `) N
Jun  7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},: x+ L$ \, R! |7 s' `$ ?
Jun  7 14:35:27 controller2 rabbitmq-server: {line,402}]},3 R' x8 D7 L( j* k2 J7 ^. W, {
Jun  7 14:35:27 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]},2 {& U/ Y0 G) ~3 s% k
Jun  7 14:35:27 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},
  h0 o* w4 P: V- L) H8 dJun  7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},
! U6 t4 z5 G8 s7 p& M, w3 g7 SJun  7 14:35:27 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
1 j5 f- k/ Z+ U+ d. TJun  7 14:35:27 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,$ z, P$ f8 G8 o- }
Jun  7 14:35:27 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
2 L7 O  F4 h/ ^8 _9 z& x0 i% C( fJun  7 14:35:27 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]
( K7 p& X. S* |9 L! |  |8 q( Q+ u$ O+ s7 K" r* `) K5 t
7 {/ v, i4 P- s; a0 z3 v
# X/ [+ j8 T4 T& X' e# w0 E
Jun  7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20504]: ERROR: RabbitMQ server is failed.
( ?# k5 K+ _3 [! IJun  7 14:35:28 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548944, rc=1, cib-update=594834, confirmed=false)& G, x6 x( m! t0 V4 q. b7 R, d
Jun  7 14:35:28 controller2 rabbitmq-server: BOOT FAILED2 n3 Z% N7 R( S% l7 _
Jun  7 14:35:28 controller2 rabbitmq-server: ===========2 k, x: c# |: _! w
Jun  7 14:35:28 controller2 rabbitmq-server: Error description:# s- k: i1 J. ]: }; u
Jun  7 14:35:28 controller2 rabbitmq-server: {could_not_start,rabbit,
* B( L7 P3 v1 z0 q$ yJun  7 14:35:28 controller2 rabbitmq-server: {bad_return,
4 V* N- j& i$ n% l& L# c/ |Jun  7 14:35:28 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},) D+ x; E6 d6 A
Jun  7 14:35:28 controller2 rabbitmq-server: {'EXIT',
  ~) _% i" P* lJun  7 14:35:28 controller2 rabbitmq-server: {rabbit,failure_during_boot,: Z0 u$ Q2 g6 A' V: n) O
Jun  7 14:35:28 controller2 rabbitmq-server: {boot_step,recovery,
5 a: Q/ x9 l% DJun  7 14:35:28 controller2 rabbitmq-server: {badmatch,
' w! Q$ n4 o; U* vJun  7 14:35:28 controller2 rabbitmq-server: {error,/ R. ^! u# T- {6 I
Jun  7 14:35:28 controller2 rabbitmq-server: {{{badmatch,
6 `, c. F3 u3 T; w- ^Jun  7 14:35:28 controller2 rabbitmq-server: {error,( \, Y3 s# H; s- k$ U1 f* D5 J
Jun  7 14:35:28 controller2 rabbitmq-server: {not_a_dets_file,
- e+ W& i# w8 }. j. x: O' lJun  7 14:35:28 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
6 s; G" E  c. S) ?5 bJun  7 14:35:28 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
8 y; H- I& E/ `1 ^6 jJun  7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
3 t/ t. B0 `7 h- [Jun  7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,6 \# n5 ]3 @) U0 W

" J) N! e9 ]1 EJun  7 14:35:28 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
2 x( W$ {5 y2 K) _3 k: f0 t  XJun  7 14:35:28 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]}," |6 A' k5 X/ ^. ?' F
Jun  7 14:35:28 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
, A1 Z' j% K0 JJun  7 14:35:28 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},) Y/ O. ]  I  l' t: X& |2 j# \' ?
Jun  7 14:35:28 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
% s/ O7 D2 |( _Jun  7 14:35:28 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},% h& [/ r' M1 `/ Z* I
Jun  7 14:35:28 controller2 rabbitmq-server: transient,4294967295,worker,, f. k/ e3 S- G, P2 m( s1 i
Jun  7 14:35:28 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}
9 b) s  u( j9 j% D4 A" K% y3 K$ tJun  7 14:35:28 controller2 rabbitmq-server: Log files (may contain more information):6 b3 S: J3 Q5 \6 c- m4 q3 V
Jun  7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
+ J/ b4 M% G3 p) c- e# l7 aJun  7 14:35:28 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log! `+ w' h" g6 Z7 D& M* ]
Jun  7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: ERROR: RabbitMQ server is failed.
% I. z" H- p4 ~( x  C& I9 `Jun  7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20526]: INFO: Resource not running.
- k8 j5 Z7 r* E5 w4 I% lJun  7 14:35:28 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548946, rc=0, cib-update=594835, confirmed=true)$ c. k, H% S* y8 D; ~: ?' g6 I! J2 F
Jun  7 14:35:28 controller2 rabbitmq-server(ksc-os-rabbitmq)[20544]: ERROR: RabbitMQ server is failed.
% a3 x5 |2 U" C9 Z# ^) X6 ~
, m, J, _2 A. T& @% kJun  7 14:35:29 controller2 systemd: Started RabbitMQ broker.7 c# R, |) w  v2 H
Jun  7 14:35:29 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}) {6 g* Q& U& x) _/ ^3 R/ L
Jun  7 14:35:29 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548947, rc=0, cib-update=594836, confirmed=true)
  @' v) i. ]- f, \Jun  7 14:35:29 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548948, rc=0, cib-update=594837, confirmed=false)* C$ f5 Q* ?" S9 E. h& [% J& ]
Jun  7 14:35:31 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump) U3 o6 F, L* _' j- ^+ Q
Jun  7 14:35:31 controller2 rabbitmq-server: init terminating in do_boot ()& t/ B7 P! f5 u* |
Jun  7 14:35:31 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE
# g/ |6 h1 G5 t% C5 ^Jun  7 14:35:31 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' ...
" ~" o+ Z4 h, i: X$ P8 [Jun  7 14:35:31 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown8 P: Q7 |, ~+ T: i$ N3 V% a6 r0 w
Jun  7 14:35:31 controller2 rabbitmqctl: DIAGNOSTICS" `# R; C7 k8 ~( c+ ?
Jun  7 14:35:31 controller2 rabbitmqctl: ===========
# ~4 _, T( T8 XJun  7 14:35:31 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']% X1 J0 [. e) Q- F- ]6 C2 v$ z
Jun  7 14:35:31 controller2 rabbitmqctl: rabbit@controller2:& M2 ^% m. t$ y1 _4 t4 y. `
Jun  7 14:35:31 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2
" J. u9 I6 _- U6 TJun  7 14:35:31 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all# ]' n9 v4 I" x
Jun  7 14:35:31 controller2 rabbitmqctl: no other nodes on controller2
, q# E) K# @" j" ]& ]2 M( FJun  7 14:35:31 controller2 rabbitmqctl: * suggestion: start the node- r. f3 Z  _$ u3 s0 X6 X% a
Jun  7 14:35:31 controller2 rabbitmqctl: current node details:
' R9 V0 G6 i) B6 S) z5 kJun  7 14:35:31 controller2 rabbitmqctl: - node name: 'rabbitmqctl-20636@controller2'+ ~% x" s0 c1 D. i" K8 K
Jun  7 14:35:31 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq
( y/ a# ^- Y2 u0 F" h9 }. MJun  7 14:35:31 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==1 W) _+ [' M  u& A
Jun  7 14:35:31 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=25 o( q" Z* a. Q! U3 ~
Jun  7 14:35:31 controller2 systemd: Unit rabbitmq-server.service entered failed state.
6 K1 d- W  c+ P% Z  gJun  7 14:35:31 controller2 systemd: rabbitmq-server.service failed.
: R9 ?8 j' L. ?" [Jun  7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800        ERROR        [publisher_pipeline_output]        pipeline/output.go:154        Failed to connect to backoff(elasticsearch(http://172.24.110.127:9200)): Get "http://172.24.110.127:9200": dial tcp 172.24.110.127:9200: connect: connection timed out, R9 u: T2 A" L8 B
Jun  7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800        INFO        [publisher_pipeline_output]        pipeline/output.go:145        Attempting to reconnect to backoff(elasticsearch(http://172.24.110.127:9200)) with 84247 reconnect attempt(s)
) e' h' ~, c1 c( M5 P+ C. S; aJun  7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800        INFO        [publisher]        pipeline/retry.go:213        retryer: send wait signal to consumer
* {+ e0 w$ u5 Z) h+ a2 @% |Jun  7 14:35:35 controller2 filebeat: 2024-06-07T14:35:35.162+0800        INFO        [publisher]        pipeline/retry.go:217          done( z3 }8 q/ k6 [% G! E
Jun  7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800        ERROR        [publisher_pipeline_output]        pipeline/output.go:154        Failed to connect to backoff(elasticsearch(http://172.24.110.125:9200)): Get "http://172.24.110.125:9200": dial tcp 172.24.110.125:9200: connect: connection timed out
% O; ]: F- @+ V2 L. z$ O8 eJun  7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800        INFO        [publisher_pipeline_output]        pipeline/output.go:145        Attempting to reconnect to backoff(elasticsearch(http://172.24.110.125:9200)) with 84378 reconnect attempt(s)3 f# b) A% L+ G. D
Jun  7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800        INFO        [publisher]        pipeline/retry.go:213        retryer: send wait signal to consumer* L8 @0 [1 n1 X
Jun  7 14:35:37 controller2 filebeat: 2024-06-07T14:35:37.219+0800        INFO        [publisher]        pipeline/retry.go:217          done% L. }# l4 V, U# @' s
Jun  7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.186 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] Start to report status of agent' d# d6 T- S, o: |
Jun  7 14:35:39 controller2 startKingCloudOSAgent: 2024-06-07 14:35:39.211 5108 INFO kingcloudos.agent.tasks.agent_tasks [-] report agent status with {u'binary': u'startKingCloudOSAgent', u'host': u'controller2.ksc', u'uuid': u'9f541bc8-e6db-4816-ae39-0eb60cc58166', u'report_count': 3145039, u'state': u'up'}
* R' A# x$ t1 h2 e4 H+ VJun  7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22417]: ERROR: RabbitMQ server is failed.% A) q  w' {8 g: {3 P; G( k. V
Jun  7 14:35:39 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548948, rc=1, cib-update=594838, confirmed=false)4 |; a- m) `1 `0 Y$ K
Jun  7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: ERROR: RabbitMQ server is failed.
% G2 t6 [- O% T& o! [+ CJun  7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22429]: INFO: Resource not running.
* G4 O& n* W0 C# u! q' oJun  7 14:35:39 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548950, rc=0, cib-update=594839, confirmed=true)  V7 D# t8 @: Z2 G
Jun  7 14:35:39 controller2 rabbitmq-server(ksc-os-rabbitmq)[22448]: ERROR: RabbitMQ server is failed.) U8 T8 @3 U; B% ^# ?; D
Jun  7 14:35:39 controller2 systemd: Starting RabbitMQ broker...( f2 O# {! B1 g5 `! u# ]6 d% A
Jun  7 14:35:40 controller2 rabbitmqctl: Waiting for 'rabbit@controller2' ...
( h5 E! f: o7 G2 G- F7 h9 xJun  7 14:35:40 controller2 rabbitmqctl: pid is 22597 ...9 k) a. ^5 Q5 Q" I
Jun  7 14:35:41 controller2 rabbitmq-server: RabbitMQ 3.4.0. Copyright (C) 2007-2014 GoPivotal, Inc.9 a4 k0 l( O* t. |
Jun  7 14:35:41 controller2 rabbitmq-server: ##  ##      Licensed under the MPL.  See http://www.rabbitmq.com/" \# Y* Q2 K5 N! P3 q( B% `
Jun  7 14:35:41 controller2 rabbitmq-server: ##  ##& s7 K2 j! j, a* R" Y' y4 J0 }
Jun  7 14:35:41 controller2 rabbitmq-server: ##########  Logs: /var/log/rabbitmq/rabbit@controller2.log
" @7 v4 t; u- k5 S# Y$ l" nJun  7 14:35:41 controller2 rabbitmq-server: ######  ##        /var/log/rabbitmq/rabbit@controller2-sasl.log* J  i: \- Y' b2 P
Jun  7 14:35:41 controller2 rabbitmq-server: ##########
4 U# v: z. x- _. D% A6 v/ s5 qJun  7 14:35:41 controller2 rabbitmq-server: Starting broker...
6 i+ w/ k, C$ K3 v$ |# d& |6 B; RJun  7 14:35:41 controller2 rabbitmq-server: BOOT FAILED! R& E5 z: r: s' x$ y9 z  `, F
Jun  7 14:35:41 controller2 rabbitmq-server: ===========
# D9 y2 Z' ^% l+ }3 _5 v% a' r8 NJun  7 14:35:41 controller2 rabbitmq-server: Error description:; c( B3 F6 X0 g3 C3 t& q+ J9 `
Jun  7 14:35:41 controller2 rabbitmq-server: {boot_step,recovery,
) P6 J* Y" E. {% ~9 h1 L+ VJun  7 14:35:41 controller2 rabbitmq-server: {badmatch,
; v/ _# p) G8 O" tJun  7 14:35:41 controller2 rabbitmq-server: {error,& @4 @# |9 n" O7 t1 N6 ]. d9 y9 L
Jun  7 14:35:41 controller2 rabbitmq-server: {{{badmatch,; h- A* p: |  B# a) X' b
Jun  7 14:35:41 controller2 rabbitmq-server: {error,! @; z7 _, U3 |9 z5 Q8 C" V/ I# w  \
Jun  7 14:35:41 controller2 rabbitmq-server: {not_a_dets_file,( Z7 N( q- I1 b) F% r: l- P# a
Jun  7 14:35:41 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
$ C% V2 T* x' R! D9 c7 t7 a+ D0 YJun  7 14:35:41 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,$ u8 S" g$ r% \# p* ~& O6 j! b3 O! o( E
Jun  7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
2 o" z8 l5 m' f. G% F( Q+ o! lJun  7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,: N4 ^' E  c1 g! @% G8 ]* a
Jun  7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
5 L$ K( K3 g0 n  [: k5 ?Jun  7 14:35:41 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},6 v" D" t% R. F0 D: q: C7 R
Jun  7 14:35:41 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,7 ?' k! Y. @/ q) [# E
Jun  7 14:35:41 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
, o* n* g) w8 N) ]; c2 tJun  7 14:35:41 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,. Z+ y+ {# x- X* ]- p
Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},5 X! |8 U! `; L& w/ o
Jun  7 14:35:41 controller2 rabbitmq-server: transient,4294967295,worker,: b& _4 o# W) M& ]* [
Jun  7 14:35:41 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}
  b5 e6 e7 x. I9 J, J( \Jun  7 14:35:41 controller2 rabbitmq-server: Log files (may contain more information):/ D7 D$ Z# o1 P. D
Jun  7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
; E1 G7 S' r% P: s& HJun  7 14:35:41 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log
5 E' a* Y* M; U  NJun  7 14:35:41 controller2 rabbitmq-server: Stack trace:
& @3 Y& S& N  M7 {, }1 K; nJun  7 14:35:41 controller2 rabbitmq-server: [{rabbit_queue_index,start,1,$ @' }* D$ n( v$ N0 x# i2 V
Jun  7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_queue_index.erl"},{line,359}]},4 @9 r% F  h$ g- ~7 X0 R
Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit_variable_queue,start,1,
" x% O2 ]+ ^: p: QJun  7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit_variable_queue.erl"},
- S* N) T( F: k, y5 pJun  7 14:35:41 controller2 rabbitmq-server: {line,402}]},
* j! z: q" S$ n1 N, ?Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit_amqqueue,recover,0,[{file,"src/rabbit_amqqueue.erl"},{line,216}]}," n9 m4 C. K5 ^5 U- \' b! O% K
Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit,recover,0,[{file,"src/rabbit.erl"},{line,656}]},0 o8 I# o, w0 ?& I' t" y: ^
Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_step/3-lc$^1/1-1-',2,[{file,"src/rabbit.erl"},{line,539}]},7 o6 s! n3 e/ S9 X9 n% \! n
Jun  7 14:35:41 controller2 rabbitmq-server: {rabbit,run_step,3,[{file,"src/rabbit.erl"},{line,538}]},
( S$ T8 S5 d' f! H, Z: a; ^& fJun  7 14:35:41 controller2 rabbitmq-server: {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,
: x6 o. c  e0 L% R  j) y6 X8 rJun  7 14:35:41 controller2 rabbitmq-server: [{file,"src/rabbit.erl"},{line,525}]},
5 ~9 m, T8 `6 t& u: z7 j. I% zJun  7 14:35:41 controller2 rabbitmq-server: {rabbit,run_boot_steps,1,[{file,"src/rabbit.erl"},{line,525}]}]( i0 B; E. T" y0 H/ T( t$ t& P
Jun  7 14:35:42 controller2 rabbitmq-server: BOOT FAILED
- R5 R/ H( ~. g3 J5 I( F( h3 bJun  7 14:35:42 controller2 rabbitmq-server: ===========
9 ~( \; ^3 @4 G& }, N5 ^% jJun  7 14:35:42 controller2 rabbitmq-server: Error description:
( W' V: w4 ~/ K/ BJun  7 14:35:42 controller2 rabbitmq-server: {could_not_start,rabbit,' u6 [; o0 n6 Z) y+ g# k
Jun  7 14:35:42 controller2 rabbitmq-server: {bad_return,' j, G8 _# e. k4 g1 W
Jun  7 14:35:42 controller2 rabbitmq-server: {{rabbit,start,[normal,[]]},
  v, i5 b2 g- N% YJun  7 14:35:42 controller2 rabbitmq-server: {'EXIT',
* v/ _6 m4 V: A4 f/ n4 T7 [& vJun  7 14:35:42 controller2 rabbitmq-server: {rabbit,failure_during_boot,. \% ~6 `* M0 a; {# @
Jun  7 14:35:42 controller2 rabbitmq-server: {boot_step,recovery,
0 m# V6 C# F0 _1 ^Jun  7 14:35:42 controller2 rabbitmq-server: {badmatch,
8 s4 `3 n" R* z/ v* D7 Y/ nJun  7 14:35:42 controller2 rabbitmq-server: {error,% O  z% ^3 [* K
Jun  7 14:35:42 controller2 rabbitmq-server: {{{badmatch,
0 X) S7 C8 `3 X) m5 eJun  7 14:35:42 controller2 rabbitmq-server: {error,2 a( w8 b, v1 R- X# J7 [) f
Jun  7 14:35:42 controller2 rabbitmq-server: {not_a_dets_file,5 h# B/ \: ^% j9 a
Jun  7 14:35:42 controller2 rabbitmq-server: "/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},
# h4 P5 u' \( u; kJun  7 14:35:42 controller2 rabbitmq-server: [{rabbit_recovery_terms,open_table,0,
8 \& j, g/ R& k9 B' p1 ?, qJun  7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,130}]},
; [! a% X, J4 x# ~9 E3 UJun  7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,init,1,2 _3 {2 v2 ?$ ?" X+ t
Jun  7 14:35:42 controller2 rabbitmq-server: [{file,"src/rabbit_recovery_terms.erl"},{line,111}]},
8 f  w3 C! c) m$ {1 }; d! j- Y& UJun  7 14:35:42 controller2 rabbitmq-server: {gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},
/ o; {8 k" C5 W  ^3 H0 BJun  7 14:35:42 controller2 rabbitmq-server: {proc_lib,init_p_do_apply,3,
4 u8 I$ \8 I1 k/ B5 kJun  7 14:35:42 controller2 rabbitmq-server: [{file,"proc_lib.erl"},{line,237}]}]},
- U( o" W' j+ |+ hJun  7 14:35:42 controller2 rabbitmq-server: {child,undefined,rabbit_recovery_terms,
6 Z9 l' ~1 Y! d* \Jun  7 14:35:42 controller2 rabbitmq-server: {rabbit_recovery_terms,start_link,[]},
. I0 B; m. d& r) CJun  7 14:35:42 controller2 rabbitmq-server: transient,4294967295,worker,
. z. t( g' H& u) F, `Jun  7 14:35:42 controller2 rabbitmq-server: [rabbit_recovery_terms]}}}}}}}}}}0 @" s8 E* j1 T
Jun  7 14:35:42 controller2 rabbitmq-server: Log files (may contain more information):
) \6 I/ G5 D: _9 I5 W2 D) fJun  7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2.log
3 A8 s; V% l! P; d! @) bJun  7 14:35:42 controller2 rabbitmq-server: /var/log/rabbitmq/rabbit@controller2-sasl.log; J  N% d3 C. B* V, g
Jun  7 14:35:43 controller2 systemd: Started RabbitMQ broker.( Y# x% D# H/ t2 J
Jun  7 14:35:43 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_start_0: ok (node=controller2.ksc, call=548951, rc=0, cib-update=594840, confirmed=true)4 l+ l8 Y7 }- r
Jun  7 14:35:43 controller2 rabbitmq-server: {"init terminating in do_boot",{rabbit,failure_during_boot,{could_not_start,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{rabbit,failure_during_boot,{boot_step,recovery,{badmatch,{error,{{{badmatch,{error,{not_a_dets_file,"/var/lib/rabbitmq/mnesia/rabbit@controller2/recovery.dets"}}},[{rabbit_recovery_terms,open_table,0,[{file,"src/rabbit_recovery_terms.erl"},{line,130}]},{rabbit_recovery_terms,init,1,[{file,"src/rabbit_recovery_terms.erl"},{line,111}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,306}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,237}]}]},{child,undefined,rabbit_recovery_terms,{rabbit_recovery_terms,start_link,[]},transient,4294967295,worker,[rabbit_recovery_terms]}}}}}}}}}}}}
% x$ Y% a. \+ AJun  7 14:35:43 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: ok (node=controller2.ksc, call=548952, rc=0, cib-update=594841, confirmed=false)
! u# {, N. g! B& s2 r. r) O5 p7 |2 qJun  7 14:35:45 controller2 rabbitmq-server: Crash dump was written to: erl_crash.dump' D1 L$ l  |  C# U$ s1 G% P
Jun  7 14:35:45 controller2 rabbitmq-server: init terminating in do_boot ()
0 T; i. ?7 M' w7 HJun  7 14:35:45 controller2 systemd: rabbitmq-server.service: main process exited, code=exited, status=1/FAILURE5 K  y4 F3 ^# e! |  b+ d' X
Jun  7 14:35:45 controller2 rabbitmqctl: Stopping and halting node 'rabbit@controller2' .../ ]& V1 U& V  C, j7 |' p( N8 a8 t
Jun  7 14:35:45 controller2 rabbitmqctl: Error: unable to connect to node 'rabbit@controller2': nodedown3 L! {7 R# H7 M6 E5 y
Jun  7 14:35:45 controller2 rabbitmqctl: DIAGNOSTICS# H( C4 w( c3 Q7 |1 Z# [
Jun  7 14:35:45 controller2 rabbitmqctl: ===========2 y! T# L, Q& W8 J
Jun  7 14:35:45 controller2 rabbitmqctl: attempted to contact: ['rabbit@controller2']
+ S/ J) n6 L9 e/ mJun  7 14:35:45 controller2 rabbitmqctl: rabbit@controller2:- q: r1 s) f0 A0 c, J; D8 C
Jun  7 14:35:45 controller2 rabbitmqctl: * connected to epmd (port 4369) on controller2- y; i! r) _" v8 K
Jun  7 14:35:45 controller2 rabbitmqctl: * epmd reports: node 'rabbit' not running at all0 u! [  {# R3 ^3 t
Jun  7 14:35:45 controller2 rabbitmqctl: no other nodes on controller2
% k& }7 h" Z: ?( bJun  7 14:35:45 controller2 rabbitmqctl: * suggestion: start the node
6 _  z0 P; l2 ]2 J; b$ K0 bJun  7 14:35:45 controller2 rabbitmqctl: current node details:) N, S$ J' M6 V0 Y# F6 U- O8 Y6 {
Jun  7 14:35:45 controller2 rabbitmqctl: - node name: 'rabbitmqctl-22956@controller2'+ }/ y" [$ A( G' S1 j
Jun  7 14:35:45 controller2 rabbitmqctl: - home dir: /var/lib/rabbitmq0 d/ V8 s& P+ W/ ^0 F( t
Jun  7 14:35:45 controller2 rabbitmqctl: - cookie hash: YqnFeQ57nhtexGsA970OWw==( W- F; \1 L% x
Jun  7 14:35:45 controller2 systemd: rabbitmq-server.service: control process exited, code=exited status=2( n/ p9 q  h# g* a
Jun  7 14:35:45 controller2 systemd: Unit rabbitmq-server.service entered failed state.
0 A4 I0 C- s. k  x0 u+ {Jun  7 14:35:45 controller2 systemd: rabbitmq-server.service failed.
7 X4 Y+ @" A' Q1 \Jun  7 14:35:45 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
! n5 \' q5 p0 ?Jun  7 14:35:45 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452185
# N# p1 S* E) o! |' ^, xJun  7 14:35:49 controller2 filebeat: 2024-06-07T14:35:49.300+0800        INFO        [monitoring]        log/log.go:145        Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":890100,"time":{"ms":6}},"total":{"ticks":2986480,"time":{"ms":48},"value":2986480},"user":{"ticks":2096380,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":28},"info":{"ephemeral_id":"2ea13f88-dfe4-4d82-bb66-f2726d6d1965","uptime":{"ms":4384770183}},"memstats":{"gc_next":33872784,"memory_alloc":17183880,"memory_total":69311206544},"runtime":{"goroutines":133}},"filebeat":{"harvester":{"open_files":17,"running":10}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":13,"events":{"active":4126,"retry":100}}},"registrar":{"states":{"current":13}},"system":{"load":{"1":2.84,"15":2.57,"5":2.66,"norm":{"1":0.071,"15":0.0643,"5":0.0665}}}}}}
9 O) d* g3 q  b+ Q% R4 L' OJun  7 14:35:53 controller2 dhcpd: isc-dhcpd-4.2.5$ u) r7 {( }6 ]. [% j$ z
Jun  7 14:35:53 controller2 rabbitmq-server(ksc-os-rabbitmq)[23948]: ERROR: RabbitMQ server is failed.
, }2 q2 R4 F( X1 [1 YJun  7 14:35:53 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_monitor_10000: unknown error (node=controller2.ksc, call=548952, rc=1, cib-update=594842, confirmed=false)
6 F7 h9 a, V+ z; R' X9 v) o1 vJun  7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: ERROR: RabbitMQ server is failed.
  y. S9 W/ c& f7 UJun  7 14:35:54 controller2 rabbitmq-server(ksc-os-rabbitmq)[23963]: INFO: Resource not running.
  A! |  T) O2 l4 z6 p$ }Jun  7 14:35:54 controller2 crmd[6475]:  notice: process_lrm_event: Operation ksc-os-rabbitmq_stop_0: ok (node=controller2.ksc, call=548954, rc=0, cib-update=594843, confirmed=true)3 s/ m! @! D4 t0 B( {
Jun  7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.029+0800        ERROR        [publisher_pipeline_output]        pipeline/output.go:154        Failed to connect to backoff(elasticsearch(http://172.24.110.126:9200)): Get "http://172.24.110.126:9200": dial tcp 172.24.110.126:9200: connect: connection timed out- c8 d( ^, o1 _3 i0 I8 e0 ~5 D$ o
Jun  7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800        INFO        [publisher_pipeline_output]        pipeline/output.go:145        Attempting to reconnect to backoff(elasticsearch(http://172.24.110.126:9200)) with 84327 reconnect attempt(s)0 F' E( N: W1 ~8 N5 H5 b( t- h
Jun  7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800        INFO        [publisher]        pipeline/retry.go:213        retryer: send wait signal to consumer3 K# y5 b3 i# H/ X4 @' D6 f
Jun  7 14:35:57 controller2 filebeat: 2024-06-07T14:35:57.030+0800        INFO        [publisher]        pipeline/retry.go:217          done
  a2 \. v9 I( V" F; a6 {/ N; C  v4 |8 \* m3 x( j! u. X& U  w
# a! k. S9 G  Q' V0 M, |
Jun  7 14:36:06 controller2 ocf-mysql-wss: INFO: GTID OK: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
+ _- y$ P. g' W7 r9 E2 r6 XJun  7 14:36:06 controller2 ocf-mysql-wss: INFO: Galera GTID: 62a7fc52-52de-11e8-a423-ee3e8b5b2a73:2044452424
" U" `4 K5 c  U0 s' ^, ^' I, T0 v4 _& h' g" k. R

& F  Z0 ]9 o4 j. q0 c& z! v6 O
您需要登录后才可以回帖 登录 | 开始注册

本版积分规则

关闭

站长推荐上一条 /4 下一条

北京云银创陇科技有限公司以云计算运维,代码开发

QQ|返回首页|Archiver|小黑屋|易陆发现技术论坛 点击这里给我发消息

GMT+8, 2026-4-8 19:06 , Processed in 0.048709 second(s), 22 queries .

Powered by Discuz! X3.4 Licensed

© 2012-2025 Discuz! Team.

快速回复 返回顶部 返回列表