- 积分
- 16840
在线时间 小时
最后登录1970-1-1
|
马上注册，结交更多好友，享用更多功能，让你轻松玩转社区。
您需要 登录 才可以下载或查看，没有账号？开始注册
x
删除时报错" M2 ]# `& a/ [! [. T+ p8 ~
[root@compute01 ~]# rbd rm -p vms volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
. M8 R9 u1 o! Z5 K# q* F0 J" ^2021-10-19 14:20:49.287 7fe204b32b00 -1 librbd::image::PreRemoveRequest: 0x563793d78b50 check_image_snaps: image has snapshots - not removing: z% j" {! D- f" }
Removing image: 0% complete...failed./ R, F9 t6 i3 K- v. R) o! G
rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed.% R$ u+ W% G( u7 o, ]: a
6 Z( ^ Q8 D/ ^3 B) q
查看是否包含子镜像：
) J1 \" v* m% ]3 ? ^4 s[root@compute01 ~]# rbd children vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106+ ]" ]7 }$ y( P7 e4 x1 v& S
: J, L' l, C6 T
9 c# c1 `& J1 |9 L- _8 O- r查看snap信息：
0 w7 L5 H6 k( P8 N[root@compute01 ~]# rbd snap ls vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
- M; J2 E# w& f) I/ fSNAPID NAME SIZE PROTECTED TIMESTAMP 7 A8 e3 c' n! L( a7 [" F
36 snapshot-a5f9935c-338a-4b48-a535-3237dd741809 1 GiB yes Mon Oct 18 17:12:22 2021 3 ?6 L4 c P9 T* y) ^( |' h7 V4 w
37 snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862 1 GiB yes Mon Oct 18 21:05:23 2021
" B" n' a3 E7 z% J+ g+ p4 H2 h; [4 p2 a6 `7 C
分离flatten 镜像：
$ j1 ^! m6 r& `$ i" W+ _[root@compute01 ~]# rbd flatten vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
6 P+ g N" [' ~/ O j4 `Image flatten: 0% complete...failed.; Y/ j; u( c6 [3 S4 j Q) F, L
rbd: flatten error: (22) Invalid argument
1 K v7 p* b+ W1 Y2021-10-19 14:22:11.267 7f51fde1bb00 -1 librbd::Operations: image has no parent9 R3 k- c5 D/ Q' _* _
?5 n% r! v# }失败了：郁闷了：
' G9 _( t: |9 Y7 a. ^" G[root@compute01 ~]# rbd flatten vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106 8 v( e% k: h7 g2 \
Image flatten: 0% complete...failed.
. H9 Q: R! l6 y1 X$ v" ?8 nrbd: flatten error: 2021-10-19 14:22:17.346 7fcfb671bb00 -1 librbd::Operations: image has no parent(22) Invalid argument8 P" Z6 F; Q3 i7 S5 J' p) C
8 t/ C! t7 W* h9 H+ m9 a% l3 {
查看其他的依然没有办法：
9 a( o' c4 e# n6 E/ |
. N' D. X, i2 ^[root@compute01 ~]# rbd flatten vms/snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862$ s/ q6 B {5 c% S( A3 t& G
rbd: error opening image snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862: (2) No such file or directory4 u& p% R& Z9 T3 r
[root@compute01 ~]# rbd children vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
) B O8 ~9 y$ k% q8 R[root@compute01 ~]# rbd flatten vms/snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862
. L$ D) T2 n( P8 Vrbd: error opening image snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862: (2) No such file or directory4 F, g. g/ F6 E, [1 y$ H
- B8 i* D" k1 U( ~" @" S5 [, L! i( ^再次查看snap信息：' N$ f z, ^( h% c1 Q+ J& b% p
[root@compute01 ~]# rbd snap ls vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
! T/ }& P1 @, d) o2 c oSNAPID NAME SIZE PROTECTED TIMESTAMP
. r, F" U3 Y% l6 c5 w2 I# C- ` 36 snapshot-a5f9935c-338a-4b48-a535-3237dd741809 1 GiB yes Mon Oct 18 17:12:22 2021 w. y# ]. G3 i, X4 y- a! t3 T1 I4 y, w
37 snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862 1 GiB yes Mon Oct 18 21:05:23 2021 4 l l2 R0 T+ R8 U0 }5 u) f* s
[root@compute01 ~]# rbd snap * r6 W8 I: A# ?
add create limit list ls protect purge remove rename revert rm rollback unprotect ' D$ {; L1 K5 H) N; c) M
[root@compute01 ~]# rbd snap $ g( h3 W1 b- j8 f$ v% I
add create limit list ls protect purge remove rename revert rm rollback unprotect
: V" w! @! c, r" b( w( X# `% [ w
9 Q' @$ T3 X! p: w( O8 i; N
尝试删除snap：) j# }7 _" s+ k5 K6 u* r
[root@compute01 ~]# rbd snap rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
7 @0 r5 r! `! w' B& crbd: snapshot name was not specified4 V3 L- |. P- w# i8 \% }
3 \6 s- X: o; B! I L* a; @检查snap ls状态：
5 c, u4 q0 ~, g[root@compute01 ~]# rbd snap ls vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862
0 ?- |6 {5 |, {" c. wrbd: snapshot name specified for a command that doesn't use it7 u, A" j& \/ s" G
1 [: i* d* ^2 a! E% o& W
[root@compute01 ~]# rbd snap ls vms/snapshot-59a87052-1b6c-469a-a989-8ffaa38cc8622 J3 ~7 f' R$ z, _0 [
rbd: error opening image snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862: (2) No such file or directory
2 b: m/ n8 k; b& N, m5 q
& T3 U4 u3 m1 Q# ?' {9 e5 e5 w* `% \/ D) b, ^5 _: m2 r
[root@compute01 ~]# rbd flatten vms/snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862
) v" a' G( a5 ?0 c+ brbd: error opening image snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862: (2) No such file or directory: \7 t2 r4 G5 N8 P# S: Y9 W
# S! Q) o5 `6 I- G& z
9 U4 N- i: m* N$ Y' r# E" P
[root@compute01 ~]# rbd snap ls vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106# S1 H# z' D1 L7 o" l
SNAPID NAME SIZE PROTECTED TIMESTAMP
, z1 I! u1 [' x. P 36 snapshot-a5f9935c-338a-4b48-a535-3237dd741809 1 GiB yes Mon Oct 18 17:12:22 2021
1 W$ W i; w/ _4 g 37 snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862 1 GiB yes Mon Oct 18 21:05:23 2021
* N4 |8 \1 i# M; @/ ^" Q6 g V$ \
, C, w6 A" E7 g- d! `; ]$ a3 |[root@compute01 ~]# rbd children vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-a5f9935c-338a-4b48-a535-3237dd741809
- b1 c) a. C/ h! ^[root@compute01 ~]# rbd children vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc8629 R" f1 k! d9 @4 U* {+ }/ h0 X9 I
/ D% ? d6 i R& r0 s
$ a* L5 a: R3 T7 l Q! x通过snap删除：
\! n! r9 v! \8 x: o. l- B[root@compute01 ~]# rbd snap rm snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862
# v2 p) h( [& J/ D4 ~$ R" i* Krbd: snapshot name was not specified
- q. d. d% I- L! t) B- e7 r7 q2 T' X7 z9 }7 Y/ m
6 o% ~. y) _) ~ y r- @1 _
删除snap
* J7 O7 g! }" c. T: V0 w0 q9 i- z2 X8 h; L6 O7 m7 B* l: u! E- z
[root@compute01 ~]# rbd snap rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862- a! [6 S% B% i+ ^
Removing snap: 0% complete...failed.5 n; j( D4 U( z7 e( W
rbd: snapshot 'snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862' is protected from removal.
9 d; V2 p" _/ V) U/ y2021-10-19 14:28:08.361 7f33d8a03b00 -1 librbd::Operations: snapshot is protected
) r& @# [; V7 s1 j( A2 [. ^
, }8 o$ V9 v/ v) M
6 K" N7 m: }$ ~1 u取消snap 保护：4 H) o9 @- ~ ~9 H8 I
[root@compute01 ~]# rbd snap unprotect vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862; w5 \7 y4 b/ O+ I4 y" h, M
0 ^$ ]' K/ Y% I- L! [ I8 b$ D; t6 w
- n* ~# @& \$ i" C" c$ C
/ v/ T1 I _9 |7 i+ W# \9 h3 T[root@compute01 ~]# rbd snap unprotect vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862@snap
6 \1 c5 J" B4 `- q( L8 u* m6 X" y5 Yrbd: unprotecting snap failed: (2) No such file or directory4 ~# H$ l8 J. R: F3 t
* y' Y( s& K [, A8 r! }7 M
再次执行：
. u5 A0 D% n- A, c1 h& q[root@compute01 ~]# rbd snap unprotect vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc862
- G# v' m/ t; B! m$ qrbd: snap is already unprotected [/ A: S0 W, B) \
( T4 V0 b, v. P* H" _6 J
删除成功：; {( p/ b2 f4 P4 o
[root@compute01 ~]# rbd snap rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-59a87052-1b6c-469a-a989-8ffaa38cc8621 W2 U7 y# Y9 r# m1 M9 ]
Removing snap: 100% complete...done.
$ u& l3 t' c8 ^3 s3 G0 ?
9 w$ K+ o/ {% Y w4 Y# D. k7 H' r S0 b1 _
[root@compute01 ~]# rbd snap rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-a5f9935c-338a-4b48-a535-3237dd741809+ k# M% j& c- P, n9 l8 z
Removing snap: 2021-10-19 14:29:05.450 7fe3d0f69b00 -1 librbd::Operations: snapshot is protected0% complete...failed.
) I* a9 ?! t# Arbd: snapshot 'snapshot-a5f9935c-338a-4b48-a535-3237dd741809' is protected from removal.
( b. {9 [) i" [/ {* i. z( i5 [" ^/ z5 a; ~
0 v, q" R9 T6 O5 j
尝试第二个取消保护： ^. f5 p& p$ _- V
[root@compute01 ~]# rbd snap unprotect vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-a5f9935c-338a-4b48-a535-3237dd741809
1 z2 c3 O/ A4 S- a7 }5 s[root@compute01 ~]# rbd snap unprotect vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-a5f9935c-338a-4b48-a535-3237dd741809, q7 d) O( g) m# b- M
rbd: snap is already unprotected
* e% m: ]) [- w3 V$ Q6 k删除snap，删除成功：
8 Z s/ |( D1 y. |. @[root@compute01 ~]# rbd snap rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106@snapshot-a5f9935c-338a-4b48-a535-3237dd741809
- p/ d' [$ _3 ?8 u. V7 {# vRemoving snap: 100% complete...done.
* @9 |# y6 w0 I& }2 Z% D% B
' f* o. l2 f+ K4 k% a( ^4 f3 a" G. u查看snap 列表：
/ c3 a# n' q% a! Q, E/ b" v) v. C2 D[root@compute01 ~]# rbd snap ls vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106
1 }" }! e4 D0 W% U3 ~1 \- J8 p+ Y' V9 Y" X! j# I
7 m! l% V1 J. G- _6 a) f0 [
[root@compute01 ~]# rbd rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106/ g) P p9 X0 g& r0 ]+ F- x+ `% C) E
2021-10-19 14:29:44.232 7fbf6dffb700 -1 librbd::image::PreRemoveRequest: 0x558c03e97860 check_image_watchers: image has watchers - not removing: Y+ V9 C1 q) {' L' A
Removing image: 0% complete...failed.: O8 t$ |' n* E W3 F. U' |
rbd: error: image still has watchers
6 u. V4 N" {! z+ i6 C" `This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.. ?4 k4 W4 J; e+ A: v2 r
% c7 o, i. n3 C5 w6 I
; g* l5 \7 O" I2 W6 `查看运行状态：
" ^: T! N) ?& u' k6 g[root@compute01 ~]# rbd status vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff1068 R/ W. `7 d7 D! ?
Watchers:
5 U/ s7 x8 @7 Y' q6 @* d0 f9 G+ X& |# G watcher=192.168.0.77:0/3193690701 client.125123467 cookie=94424575476608% z {- E5 L+ R$ e
[root@compute01 ~]# ceph osd bl$ G3 {0 P% ~; g9 a% ~ X' n* Y
blacklist blocked-by
/ }3 j, x1 `- u( ?$ H8 ` B {: [/ I
添加黑名单：
3 W, ]% A I2 D0 M6 M3 G! a[root@compute01 ~]# ceph osd blacklist add 192.168.0.77:0/31936907010 }: ^; {" [4 D9 d' o
blacklisting 192.168.0.77:0/3193690701 until 2021-10-19 15:30:19.739160 (3600 sec)" ?, v0 l( q3 m5 e0 `; h
8 Q' r3 Q& j; K( W6 ^7 [
% J) T% P) ~9 u' X. v8 c- R6 v再次删除镜像：, k6 h- y3 p- p) B
[root@compute01 ~]# rbd rm vms/volume-b75a1ff5-606b-45ca-9a4a-b4327d6ff106* j% e2 j: C5 u' G
Removing image: 100% complete...done.9 p' M) t [# m! ~9 ?3 A# }# Z& ~
6 W0 u+ \3 y8 @# n! M( o0 ? J" N# ~9 C" h
成功删除镜像。
) @- o7 p0 t) g8 p, v1 z
' Y# h6 ~ r6 N# u( T. l+ J0 o) l) y" w1 T5 B
) A' o* g, ^' Q$ m. e/ e/ W- N
|
|
/4 
窥视卡
雷达卡
发表于 2021-10-19 15:00:03
提升卡
置顶卡
沉默卡
喧嚣卡
变色卡
千斤顶
照妖镜
楼主
