ERROR nova.scheduler.utils qemu unexpectedly closed the monitor

admin

2022-10-20 10:45:08.266 37 ERROR nova.scheduler.utils [req-035fc933-de6b-448a-978e-c15ae171daeb a3cfa6f70675429985132daa6d3b906e 0c915a0d7601493cb1ecfd904b09f54c - default default] [instance: 52baa020-426b-4800-9492-0654b834ef2a] Error from last host: compute07 (node compute07): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 52baa020-426b-4800-9492-0654b834ef2a was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2022-10-20 10:44:54.063891 7fded43821c0 -1 Errors while parsing config file!\n2022-10-20 10:44:54.063897 7fded43821c0 -1 parse_file: cannot open /etc/ceph/ceph.conf: (13) Permission denied\n2022-10-20T02:44:54.292119Z qemu-kvm: -drive file=rbd:hdd-8T-volumes/volume-41da2d70-d3bd-4187-9f60-8b262286f292:id=cinder:auth_supported=cephx\\;none:mon_host=192.168.0.75\\:6789\\;192.168.0.77\\:6789\\;192.168.0.79\\:6789\\;192.168.0.86\\:6789\\;192.168.0.89\\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=41da2d70-d3bd-4187-9f60-8b262286f292,cache=none,discard=unmap: error reading header from volume-41da2d70-d3bd-4187-9f60-8b262286f292: No such file or directory\n']


4 n9 v) b9 F% i( L4 T+ U) b应该是ceph中pool池的权限问题
0 ?7 X! ~) ]3 k$ L, O7 c5 y

admin

[root@controller1 src]# ceph auth caps client.nova mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=images,allow rwx pool=ssd-volumes,allow rwx pool=hdd-2.4T-volumes,allow rwx pool=hdd-8T-volumes,allow rwx pool=nova-vms,allow rwx pool=backups'
& W+ D5 a" a$ {' z  r+ f4 T$ fupdated caps for client.nova

admin

0

+ M+ Q$ s9 Y3 ]8 f6 z/ `1 v
As noted in Openstack docs [1], rebuild is not supported for volume-based VMs.

Assuming you are trying to rebuild the VM with a fresh image ("factory reset"), a slightly "hacky" solution is to replace the underlying volume with the fresh image while keeping the same pool/path.

: S% t+ `) ?# g6 o0 D/ ]5 kFor Ceph based backend, it would be something like

: i8 a. w, U0 {% uopenstack volume show <...> => Get pool/path from rbd backend
openstack image show <...> => Get pool/path from rbd backend
: N, w3 W$ k+ V2 I, T. iopenstack server stop <VM> => Stop the VM
' {0 d5 _0 K5 R& j2 m' x
rbd -p <POOL NAME> mv <VM VOLUME UUID>  <VM VOLUME UUID>.old
/ d) F0 z4 Y- @: r: G, frbd -p <POOL NAME> cp <IMAGE VOLUME UUID> <VM VOLUME UUID>
Once the copy finishes, start the VM
5 k* P( i' }' U$ e6 n6 G
" |- }. O8 j6 G0 u9 z- V- mopenstack server start <VM>

admin

Nova:
1 h( F- E3 `6 [7 S1 yList of instances
% f& e/ J9 y5 I1
openstack server list
2
: m. b0 E$ U7 C4 e/ S  T/ `nova list
Details on a specific instance
) A; j( y$ v3 b4 y- ~+ C1
# k( q! d0 ^9 F) H* {# popenstack server show <server id>
4 Y! v2 L1 p( I: P# V7 P; [2
nova show <server id>
Rebuild an instance
  t; K0 R$ e* n1 ?9 O" }1
openstack server rebuild --image <image-id> <server-id>
7 Y& B( V: q" G3 b  f2
7 r! Q( Q  y  p6 Rnova rebuild <server-id> <image-id>
8 h" ^0 ^8 Z# Y& U: mRebuild an instance with metadata
' ~( A( [& ]' s! M1
% o9 O' a$ C) D/ W+ v- Z' X: m0 }openstack server set --property <meta> <server-id>
& h! @  {1 L  k2 I2
nova meta <server-id> set <meta>
% A  b) \+ w0 `1 J2 b3
nova rebuild --meta <meta> <server-id> <image-id>
+ ]1 t! O( i+ A  yAttach a port to an instance
1
$ q' O* W/ q  D% a$ Snova interface-attach --port-id <port id> <instance id>
Create a instance from a availability zone
1
+ K# g% n& b& v" ^; @  bnova boot --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
2
# u0 [: u# D, o- G9 }openstack server create --availability-zone nova:metal01:<ironic-id> --flavor <flavor-id> --image <img-id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> <name>
Create a instance with meta property, sec group, fixed ip, ssh-key
, P8 q" J' M" x1
openstack server create --image <image id> --flavor <flavor id> --nic net-id=<network id>,v4-fixed-ip=<ip-address> --property <meta-data> --security-group <security group id> --key-name <keypair name> vmname
2 @! T, q( K- d  E5 k: {: aCreate a instance
$ F  q3 U' E1 G7 c. _) I+ L, j6 g1
openstack server create --image <image id> --flavor <flavor id> vmname
Remove error state from instance
1
nova reset-state --active <server-id>
( i8 W9 c: W! W/ h. v! s; zChange the flavour (resize)
1
+ {2 m7 }, u) ?; p% e  h& Y  u) Fopenstack server resize --flavor <flavor> <ID>
1 b9 }3 F5 E' M7 }Neutron:
List of subnets and network ID
. j+ O$ S  ^" A. A8 \  w1
openstack network list
2
- J$ H8 _1 A; s1 e0 N8 R/ tneutron net-list
List of subnets, their IDs and allocation pools:
1
9 q7 J% ^5 t+ Topenstack subnet list
2
0 \4 S' g5 A! H5 l9 r9 B8 M2 bneutron subnet-list
List ports
0 \6 G( E( x1 y8 ]3 W1 Y$ b& z1
/ z' a7 b% ], ?# |& qopenstack port list
' h9 V: k" G  l, c4 f2
% m" o! e  E% g; @neutron port-list
Create port
1
openstack port create --network <network id> --fixed-ip subnet=<subnet id>,ip-address=<ip-address>
2
2 u) @* i2 x. B. L! bneutron port-create --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <network id> <name>
Update or Set/Unset port
1
# ~0 e) c( y! o) Qneutron port-update --fixed-ip subnet_id=<subnet id>,ip_address=<ip-address> --fixed-ip subnet_id=<subnet id>,ip_address=<X.X.X.X> <port id>
5 X: p% i& Q6 Y. R4 n2
openstack port set --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
; h" q. m0 X! s! b4 f; h3
openstack port unset --fixed-ip subnet=<subnet>,ip-address=<ip-address> <port id>
% r& I2 G6 S" D4 E- e1 _Get details on a port
- g. {3 e( b7 C2 d+ }" a7 G1
openstack port show <port id>
2
neutron port-show <port id>
' R+ v3 D  ]  s. y3 `3 c( t6 b% }( _Allowed address pairs - (Allows one port to add additional IP/MAC address pairs on that port to allow traffic that matches those specified values.)
1
neutron port-update <port-uuid> --allowed-address-pairs type=dict list=true ip_address='0.0.0.0/0'
Glance:
List images
1
& u/ [- s6 h* g$ {  P8 popenstack image list
2
glance image-list
Get details on an image
1 Z$ I) b6 w3 O4 G+ l% w1
glance image-show <image id>
Upload a image
1
2 u5 {* L( p' Z, i, G, [$ X/ Dopenstack image create --disk-format qcow2 --container-format bare --public --file ./centos7.qcow2 centos7-image
Delete
1 B7 h; D8 G4 R1
openstack image delete <ID>
Download a image
1
glance image-download <img-id> --file img.qcow2
9 Y7 `2 \  e6 s  sChange state
2 K' y6 F3 \. s$ H1 x  P1 M1
cinder reset-state --state in-use <id>
Other:
List flavors
* R) R9 M9 Y: z' r* y  n5 v  N$ ]1
openstack flavor list
List keypairs
1
  n' {. S" I& E% Kopenstack keypair list
1 j0 W$ e! C; o/ E' R$ e8 eList Security groups
' C9 w/ T) ^1 a1 f" E' A1
- k, F; k$ N3 Copenstack security group list
& m# |& T! ^+ C: z4 cCinder
1
1 N9 r- }; g3 _; hopenstack volume set --state error <id>
Stop a migraion

Remove the active volume from the migration state

1
: I# A) F# G9 ~* }: Hcinder reset-state <id> --reset-migration-status
( }3 w; w5 u( D# R& Ufind the volume in the attaching state and remove it

0 s4 {7 k. h' i9 a# \# P1
! e, b* \2 @- l, t! Uopenstack volume list
" Y8 l  F0 p& N, w1
cinder reset-state <id> --state error
1
4 V+ T& Z$ x5 h" g4 Ucinder reset-state <id> --reset-migration-status
) l8 n  _" {* N. e) @' {openstack volume delete <id>
* c& k) B  w* T8 \1 ~5 Y1
  G& d6 l1 c' Y( q+ w/ K( Zopenstack volume delete <id>