ERROR nova.scheduler.utils qemu unexpectedly closed the monitor

admin

2022-10-20 10:45:08.266 37 ERROR nova.scheduler.utils [req-035fc933-de6b-448a-978e-c15ae171daeb a3cfa6f70675429985132daa6d3b906e 0c915a0d7601493cb1ecfd904b09f54c - default default] [instance: 52baa020-426b-4800-9492-0654b834ef2a] Error from last host: compute07 (node compute07): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 52baa020-426b-4800-9492-0654b834ef2a was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2022-10-20 10:44:54.063891 7fded43821c0 -1 Errors while parsing config file!\n2022-10-20 10:44:54.063897 7fded43821c0 -1 parse_file: cannot open /etc/ceph/ceph.conf: (13) Permission denied\n2022-10-20T02:44:54.292119Z qemu-kvm: -drive file=rbd:hdd-8T-volumes/volume-41da2d70-d3bd-4187-9f60-8b262286f292:id=cinder:auth_supported=cephx\\;none:mon_host=192.168.0.75\\:6789\\;192.168.0.77\\:6789\\;192.168.0.79\\:6789\\;192.168.0.86\\:6789\\;192.168.0.89\\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=41da2d70-d3bd-4187-9f60-8b262286f292,cache=none,discard=unmap: error reading header from volume-41da2d70-d3bd-4187-9f60-8b262286f292: No such file or directory\n']
. s: M5 ^' n9 C" p( h3 I

( T3 B5 I0 v! \; ]; V6 L应该是ceph中pool池的权限问题

admin

[root@controller1 src]# ceph auth caps client.nova mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=images,allow rwx pool=ssd-volumes,allow rwx pool=hdd-2.4T-volumes,allow rwx pool=hdd-8T-volumes,allow rwx pool=nova-vms,allow rwx pool=backups'
updated caps for client.nova

admin

0
- ?5 d# o5 T4 j2 x) X& S) r

8 {. _* f4 [( y$ PAs noted in Openstack docs [1], rebuild is not supported for volume-based VMs.

) E& ]6 V5 S; a5 c, a* XAssuming you are trying to rebuild the VM with a fresh image ("factory reset"), a slightly "hacky" solution is to replace the underlying volume with the fresh image while keeping the same pool/path.

5 I" t$ s; O# g: X9 DFor Ceph based backend, it would be something like

openstack volume show <...> => Get pool/path from rbd backend
8 Z( B/ S& b9 d# G/ o- }openstack image show <...> => Get pool/path from rbd backend
openstack server stop <VM> => Stop the VM

rbd -p <POOL NAME> mv <VM VOLUME UUID>  <VM VOLUME UUID>.old
rbd -p <POOL NAME> cp <IMAGE VOLUME UUID> <VM VOLUME UUID>
Once the copy finishes, start the VM
, e8 E8 g8 l" N0 w# h7 d* C
openstack server start <VM>

admin

Nova:
List of instances
6 O  r3 `% `' |6 p- a# @' ~1
openstack server list
5 q0 Z) ~5 |: Y1 S2
nova list
, `/ s$ M6 S1 V: b7 }9 MDetails on a specific instance
. z9 u! E- U. m7 L1
openstack server show <server id>
% ~- K8 q4 g  s: d- v2
nova show <server id>
( v0 e5 T: p) S  c& D9 hRebuild an instance
5 B7 O# Z9 K1 R- t3 y9 G5 ?4 w1
/ g5 y; D* F' Hopenstack server rebuild --image <image-id> <server-id>
2
nova rebuild <server-id> <image-id>
Rebuild an instance with metadata
1
openstack server set --property <meta> <server-id>
9 @0 k+ t  X1 T/ }2 Z7 N& x4 ?2
! r. D# {* J8 P4 Cnova meta <server-id> set <meta>
3
. z5 e+ L+ S, k3 X4 ?3 L  g$ bnova rebuild --meta <meta> <server-id> <image-id>
! ]- U* r$ }8 g! z5 Y% YAttach a port to an instance
: T! i( d; A  t1
4 w4 d) l2 b5 S3 i* lnova interface-attach --port-id <port id> <instance id>
  C! a) u$ R: B2 `" @Create a instance from a availability zone
1
nova boot --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
( S$ q3 |( Q9 t% z# V& \% |2
1 h, f8 I( O& {$ @1 q  s6 r1 Zopenstack server create --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
6 ^: F1 D# w/ R0 i  e* LCreate a instance with meta property, sec group, fixed ip, ssh-key
. E0 \& L) ]9 v/ w0 X3 e+ U6 z1
' \" L& x) }4 g2 `4 p1 oopenstack server create --image <image id> --flavor <flavor id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> --property <meta-data> --security-group <security group id> --key-name <keypair name> vmname
Create a instance
; Z9 I! P) q! T# s2 ?" v1
' v9 z& c6 X% q0 l" [) |& Hopenstack server create --image <image id> --flavor <flavor id> vmname
Remove error state from instance
1
nova reset-state --active <server-id>
9 R; |( S' o' g+ K4 o! m3 Z6 YChange the flavour (resize)
1
openstack server resize --flavor <flavor> <ID>
Neutron:
List of subnets and network ID
$ n! {5 j$ [' ^, c1 g1
openstack network list
2
neutron net-list
3 p4 C& D  ^, [8 `& [List of subnets, their IDs and allocation pools:
1
: q! Y" }% q8 N. B: gopenstack subnet list
5 s# o* U, _$ `* O& r/ S2
neutron subnet-list
List ports
& G, u+ R8 C4 R; f: L# y1 @1
& d) j. b  C0 Q  N- O4 K0 eopenstack port list
2
7 I2 }- T) \( P0 V. T  Eneutron port-list
Create port
4 V( X$ t, N) D  j' J" x1
openstack port create --network <network id> --fixed-ip subnet=<subnet id>,ip-address=<ip-address>
2
% M0 n+ O( v2 ~/ a1 i. g, N7 vneutron port-create --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <network id> <name>
Update or Set/Unset port
1 X) S1 M/ k$ l6 u- X9 A/ @( T1
+ N+ b: s3 |) d( \neutron port-update --fixed-ip subnet_id=<subnet id>,ip_address=<ip-address> --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <port id>
2
( E% E* U, ^! j5 z; Vopenstack port set --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
% M* X+ E4 F* p/ T; i  X* y4 e3
- E  d$ A' o& l7 Z5 bopenstack port unset --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
Get details on a port
1
openstack port show <port id>
+ Q2 F; F4 @( z0 @1 f8 Q2
0 K0 P( O! X% o% j0 uneutron port-show <port id>
Allowed address pairs - (Allows one port to add additional IP/MAC address pairs on that port to allow traffic that matches those specified values.)
1
neutron port-update <port-uuid> --allowed-address-pairs type=dict list=true ip_address='0.0.0.0/0'
+ [! \: M$ U/ ]+ i6 y% |6 W% w" g2 ?: TGlance:
. g+ f" a- U5 x" fList images
- J3 W  q" ^& o. k: Z0 E1
openstack image list
8 d% P. u) Q, R8 `/ o) [# Q2
glance image-list
Get details on an image
% `5 |7 g3 \; N7 O7 e. K1
0 g; Y/ ]4 }" D9 t7 V' |glance image-show <image id>
Upload a image
9 D' Z! \/ o/ G* y1
openstack image create --disk-format qcow2 --container-format bare --public --file ./centos7.qcow2 centos7-image
, H6 f3 k# [5 ?2 L4 XDelete
) c7 Y5 c( v$ U; t) q$ f) G8 l1
' I! v1 m2 Q* k- p2 O, Q: oopenstack image delete <ID>
; L  l3 |) E0 t* J% g" Z1 s& H  ^5 ]Download a image
1
glance image-download <img-id> --file img.qcow2
Change state
1
/ F) T0 ]7 D3 t# E4 x: L! v( mcinder reset-state --state in-use <id>
Other:
List flavors
1 w% A8 l% {' `& ?" Y6 [& P* U1
openstack flavor list
List keypairs
7 o0 y& w; Z! ]) _' C8 w1
/ p& I5 o) R' h  U, B& m) jopenstack keypair list
List Security groups
+ W+ p2 b( I9 Y. H# `0 t' V1
6 g0 \* a# O$ g# Wopenstack security group list
Cinder
1
openstack volume set --state error <id>
Stop a migraion

Remove the active volume from the migration state
# c8 O. ~) T4 K: g# l
- ?' Q, h9 V0 p7 M5 c* w/ U1
cinder reset-state <id> --reset-migration-status
; `( m5 C' F! ]6 L. `find the volume in the attaching state and remove it

4 v# H! W. \" p1 h6 w; [1
openstack volume list
/ D* F: F, X% s. C$ Q1
; K5 m; K( c3 f  n6 y& L+ vcinder reset-state <id> --state error
1
  A1 R" N- K$ k8 m) S# T: c5 \cinder reset-state <id> --reset-migration-status
5 |4 s7 Q8 N2 D: c" n7 }/ h5 A7 \: ~openstack volume delete <id>
8 Y6 O+ Y, ~; x/ l1
openstack volume delete <id>