VirtualMachineInstance create failed #11787

jiangxiaobin96 · 2024-04-25T01:37:52Z

Error when creating VirtualMachineInstance.

error of pod/virt-launcher-testvm-2dskd

{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get session bus connection: Cannot spawn a message bus without a machine-id: Unable to load /var/lib/dbus/machine-id or /etc/machine-id: Failed to open file “/var/lib/dbus/machine-id”: No such file or directory","pos":"virGDBusGetSessionBus:126","subcomponent":"libvirt","thread":"46","timestamp":"2024-04-24T17:22:50.394000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get system bus connection: Could not connect: No such file or directory","pos":"virGDBusGetSystemBus:99","subcomponent":"libvirt","thread":"46","timestamp":"2024-04-24T17:22:50.394000Z"}
{"component":"virt-launcher-monitor","level":"error","msg":"dirty virt-launcher shutdown: exit-code 2","pos":"virt-launcher-monitor.go:143","timestamp":"2024-04-24T17:27:53.868555Z"}

cluster information

kubevirt       pod/virt-api-56fbd84dd5-b6tdd              1/1     Running   0          8h
kubevirt       pod/virt-api-56fbd84dd5-zh7qz              1/1     Running   0          8h
kubevirt       pod/virt-controller-7f68fbd688-8gk2b       1/1     Running   0          8h
kubevirt       pod/virt-controller-7f68fbd688-rmlsz       1/1     Running   0          8h
kubevirt       pod/virt-handler-k4dns                     1/1     Running   0          8h
kubevirt       pod/virt-handler-zgkjq                     1/1     Running   0          8h
kubevirt       pod/virt-launcher-testvm-2dskd             0/2     Error     0          7h57m
kubevirt       pod/virt-operator-8b8d65f8f-2wtnr          1/1     Running   0          8h
kubevirt       pod/virt-operator-8b8d65f8f-6ps6l          1/1     Running   0          8h

virtctl version
Client Version: version.Info{GitVersion:"v1.2.0", GitCommit:"f26e45d99ac35743fc33d6a121b629e9a9af6b63", GitTreeState:"clean", BuildDate:"2024-03-05T20:34:24Z", GoVersion:"go1.21.5 X:nocoverageredesign", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{GitVersion:"v1.0.1", GitCommit:"5e8660a7ba53fe05266a20960f4e8e1ef3e1104b", GitTreeState:"clean", BuildDate:"2023-10-17T20:33:17Z", GoVersion:"go1.19.12", Compiler:"gc", Platform:"linux/amd64"}

kubectl version
Client Version: v1.29.4
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: v1.29.4

host information

$ cat /etc/os-release
NAME="Ubuntu"
VERSION="20.04.6 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.6 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal

kubevirt deployment

wget https://github.com/kubevirt/kubevirt/releases/download/v1.2.0/kubevirt-operator.yaml
wget https://github.com/kubevirt/kubevirt/releases/download/v1.2.0/kubevirt-cr.yaml

sudo kubectl apply -f kubevirt-operator.yaml --kubeconfig ~/.kube/config
sudo kubectl apply -f kubevirt-cr.yaml --kubeconfig ~/.kube/config

vm deployment

sudo kubectl apply -f vm.yaml --kubeconfig ~/.kube/config
cat vm.yaml
---
apiVersion: kubevirt.io/v1
kind: VirtualMachineInstance
metadata:
  labels:
    kubevirt.io/size: small
    kubevirt.io/domain: testvm
    debugLogs: "true"
    logVerbosity: "6"
  name: testvm
  namespace: kubevirt
spec:
  domain:
    devices:
      disks:
        - name: containerdisk
          disk:
            bus: virtio
      interfaces:
      - name: default
        masquerade: {}
    resources:
      requests:
        memory: 64M
  networks:
  - name: default
    pod: {}
  volumes:
    - name: containerdisk
      containerDisk:
        image: docker.io/kubevirt/cirros-registry-disk-demo

The text was updated successfully, but these errors were encountered:

EdDev · 2024-04-25T03:54:53Z

You better check why your node is missing the machine-id file.

ref: https://man7.org/linux/man-pages/man5/machine-id.5.html

jiangxiaobin96 · 2024-04-25T13:03:07Z

I run sudo dbus-uuidgen | sudo tee /var/lib/dbus/machine-id and machine-id exists in node, but the error have not been solved.

$ ls /var/lib/dbus/machine-id 
/var/lib/dbus/machine-id

alicefr · 2024-04-26T07:35:52Z

Can you please attach the entire virt-launcher log file?

jiangxiaobin96 · 2024-04-26T12:16:21Z

whole vrt-launcher log file

{"component":"virt-launcher-monitor","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher-monitor.go:73","timestamp":"2024-04-26T12:09:49.683947Z"}
{"component":"virt-launcher","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher.go:366","timestamp":"2024-04-26T12:09:49.715422Z"}
{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:86","timestamp":"2024-04-26T12:09:49.715473Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:89","timestamp":"2024-04-26T12:09:49.715505Z"}
{"component":"virt-launcher","level":"info","msg":"Enabling libvirt log filters: 3:remote 4:event 3:util.json 3:util.object 3:util.dbus 3:util.netlink 3:node_device 3:rpc 3:access 3:util.threadjob 3:cpu.cpu 3:qemu.qemu_monitor 1:*","pos":"libvirt_helper.go:510","timestamp":"2024-04-26T12:09:49.716185Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu+unix:///session?socket=/var/run/libvirt/virtqemud-sock","pos":"libvirt.go:524","timestamp":"2024-04-26T12:09:49.716228Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/virtqemud-sock': No such file or directory')","pos":"libvirt.go:532","timestamp":"2024-04-26T12:09:49.716581Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 9.0.0, package: 3.el9 (builder@centos.org, 2023-02-01-12:58:56, )","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.725000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: testvm","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.725000Z"}
{"component":"virt-launcher","level":"info","msg":"outputs=1:stderr","pos":"virLogParseOutputs:1641","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.725000Z"}
{"component":"virt-launcher","level":"info","msg":"output=1:stderr","pos":"virLogParseOutput:1488","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.725000Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 9.0.0, package: 3.el9 (builder@centos.org, 2023-02-01-12:58:56, )","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: testvm","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on pid file path '/var/run/libvirt/virtqemud.pid'","pos":"main:962","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on socket paths '/var/run/libvirt/virtqemud-sock', '<null>' and '/var/run/libvirt/virtqemud-admin-sock'","pos":"main:973","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Ensuring run dir '/var/run/libvirt' exists","pos":"main:1008","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load qemu","pos":"virDriverLoadModule:57","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'qemu' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virFileFindResourceFull:1814","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Load module file '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virModuleLoadFile:48","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.726000Z"}
{"component":"virt-launcher","level":"info","msg":"Lookup function 'qemuRegister'","pos":"virModuleLoadFunc:69","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"driver=0x7f8e385fa3a0 name=QEMU","pos":"virRegisterConnectDriver:516","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"registering QEMU as driver 3","pos":"virRegisterConnectDriver:527","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Attempting to configure auditing subsystem","pos":"main:1138","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/daemon","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/daemon.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/qemu","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/qemu.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/lxc","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/lxc.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/network","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/network.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/libxl","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/libxl.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/bhyve","pos":"virHookCheck:159","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/bhyve.d is not accessible","pos":"virHookCheck:170","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Setting up networking from caller","pos":"virSystemdGetListenFDs:813","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No LISTEN_PID from caller","pos":"virSystemdGetListenFDs:816","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"No activation FDs present","pos":"virSystemdGetActivation:915","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Skipping systemd notify, not requested","pos":"virSystemdNotifyStartup:628","subcomponent":"libvirt","thread":"29","timestamp":"2024-04-26T12:09:49.728000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for Remote state driver","pos":"virStateInitialize:650","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=1)","pos":"virStateInitialize:658","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for QEMU state driver","pos":"virStateInitialize:650","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:233","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"filename=/var/run/kubevirt-private/libvirt/qemu.conf","pos":"virConfReadFile:723","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry stdio_handler 0x7f8df401e560","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_listen 0x7f8df40209c0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_tls 0x7f8df4020a20","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_sasl 0x7f8df4020af0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry user 0x7f8df4020be0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry group 0x7f8df4020cd0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry dynamic_ownership 0x7f8df4020da0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry remember_owner 0x7f8df4020ed0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry namespaces 0x7f8df4020f50","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry cgroup_controllers 0x7f8df4020fb0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry virtiofsd_debug 0x7f8df40210a0","pos":"virConfAddEntry:214","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f8df4020a20 2","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f8df40209c0 3","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f8df4020af0 2","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value unsigned long long (nil) 0","pos":"virConfGetValueULLong:1288","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f8df401e560 3","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1037","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1086","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f8df40210a0 2","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f8df4020be0 3","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f8df4020cd0 3","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f8df4020da0 2","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f8df4020ed0 2","pos":"virConfGetValueBool:989","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f8df4020fb0 4","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1037","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f8df4020f50 4","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:865","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.729000Z"}
{"component":"virt-launcher","level":"info","msg":"name=nop driverName=qemu configDir=/var/run/kubevirt-private/libvirt flags=0x0","pos":"virLockManagerPluginNew:130","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"version=1000000 configFile=/var/run/kubevirt-private/libvirt/qemu-nop.conf flags=0x0","pos":"virLockManagerNopInit:34","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"name=<null>","pos":"virSecurityDriverLookup:54","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"Not enabled name=selinux","pos":"virSecurityDriverLookup:70","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"Probed name=none","pos":"virSecurityDriverLookup:65","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"Auto-probed security driver is \"none\"; confined guests will not be created","pos":"virSecurityManagerNew:197","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f8e3b32a400 (none) virtDriver=QEMU flags=0x0","pos":"virSecurityManagerNewDriver:85","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f8e3b32a8c0 (stack) virtDriver=QEMU flags=0x0","pos":"virSecurityManagerNewDriver:85","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:233","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.730000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:233","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:233","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:233","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /var/run/libvirt/qemu/run","pos":"virDomainObjListLoadAllConfigs:575","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /var/run/kubevirt-private/libvirt/qemu","pos":"virDomainObjListLoadAllConfigs:575","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"Autostart file /var/run/libvirt/qemu/run/autostarted does not exist, do autostart","pos":"virDriverShouldAutostart:100","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=1)","pos":"virStateInitialize:658","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get session bus connection: Cannot spawn a message bus without a machine-id: Unable to load /var/lib/dbus/machine-id or /etc/machine-id: Failed to open file “/var/lib/dbus/machine-id”: No such file or directory","pos":"virGDBusGetSessionBus:126","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get system bus connection: Could not connect: No such file or directory","pos":"virGDBusGetSystemBus:99","subcomponent":"libvirt","thread":"45","timestamp":"2024-04-26T12:09:49.750000Z"}
{"component":"virt-launcher","level":"info","msg":"name=qemu:///session, auth=(nil), flags=0x0","pos":"virConnectOpenAuth:1269","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:913","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Split \"qemu:///session\" to URI components:","pos":"virConnectOpenInternal:958","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"  scheme qemu","subcomponent":"libvirt","timestamp":"2024-04-26T12:09:50.217680Z"}
{"component":"virt-launcher","level":"info","msg":"  server <null>","subcomponent":"libvirt","timestamp":"2024-04-26T12:09:50.217686Z"}
{"component":"virt-launcher","level":"info","msg":"  user <null>","subcomponent":"libvirt","timestamp":"2024-04-26T12:09:50.217693Z"}
{"component":"virt-launcher","level":"info","msg":"  port 0","subcomponent":"libvirt","timestamp":"2024-04-26T12:09:50.217701Z"}
{"component":"virt-launcher","level":"info","msg":"  path /session","subcomponent":"libvirt","timestamp":"2024-04-26T12:09:50.217706Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 0 (Test) ...","pos":"virConnectOpenInternal:1064","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1086","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1095","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 1 (ESX) ...","pos":"virConnectOpenInternal:1064","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1086","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1095","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 2 (remote) ...","pos":"virConnectOpenInternal:1064","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Matching any URI scheme for 'qemu'","pos":"virConnectOpenInternal:1103","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 2 remote returned DECLINED","pos":"virConnectOpenInternal:1129","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 3 (QEMU) ...","pos":"virConnectOpenInternal:1064","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1086","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Matched URI scheme 'qemu'","pos":"virConnectOpenInternal:1089","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 3 QEMU returned SUCCESS","pos":"virConnectOpenInternal:1129","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190","pos":"virConnectGetType:163","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.217000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:540","timestamp":"2024-04-26T12:09:50.217958Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=<null>, uuid=), conn=0x7f8df4013190, eventID=0, cb=0x55bc9fef1dc0, opaque=0x7f8e34002430, freecb=0x55bc9fee8400","pos":"virConnectDomainEventRegisterAny:9933","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:09:50.219000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=<null>, uuid=), conn=0x7f8df4013190, eventID=19, cb=0x55bc9fef3b70, opaque=0x7f8e20002630, freecb=0x55bc9fee8400","pos":"virConnectDomainEventRegisterAny:9933","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:09:50.219000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=<null>, uuid=), conn=0x7f8df4013190, eventID=15, cb=0x55bc9fef3630, opaque=0x7f8e28003830, freecb=0x55bc9fee8400","pos":"virConnectDomainEventRegisterAny:9933","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:09:50.219000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=<null>, uuid=), conn=0x7f8df4013190, eventID=18, cb=0x55bc9fef3a40, opaque=0x7f8e24002560, freecb=0x55bc9fee8400","pos":"virConnectDomainEventRegisterAny:9933","subcomponent":"libvirt","thread":"33","timestamp":"2024-04-26T12:09:50.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Registered libvirt event notify callback","pos":"client.go:539","timestamp":"2024-04-26T12:09:50.220071Z"}
{"component":"virt-launcher","level":"info","msg":"Marked as ready","pos":"virt-launcher.go:75","timestamp":"2024-04-26T12:09:50.220236Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:00.221338Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e337fd8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"34","timestamp":"2024-04-26T12:10:00.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:10.221113Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e395fb8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:10:10.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:20.221146Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e305f98e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:10:20.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:30.220345Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e38dfa8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:10:30.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:40.220575Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e33ffe8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"33","timestamp":"2024-04-26T12:10:40.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:10:50.220657Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e337fd8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"34","timestamp":"2024-04-26T12:10:50.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:00.220786Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e395fb8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:11:00.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:10.220903Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e305f98e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:11:10.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:20.220906Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e38dfa8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:11:20.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:30.220907Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e33ffe8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"33","timestamp":"2024-04-26T12:11:30.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:40.220721Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e337fd8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"34","timestamp":"2024-04-26T12:11:40.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:11:50.220680Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e395fb8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:11:50.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:00.220674Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e305f98e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:12:00.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:10.220786Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e38dfa8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:12:10.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:20.220756Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e33ffe8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"33","timestamp":"2024-04-26T12:12:20.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:30.220925Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e337fd8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"34","timestamp":"2024-04-26T12:12:30.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:40.221026Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e395fb8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:12:40.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:12:50.220287Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e305f98e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:12:50.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:13:00.220418Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e38dfa8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"31","timestamp":"2024-04-26T12:13:00.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:13:10.221024Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e33ffe8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"33","timestamp":"2024-04-26T12:13:10.221000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:13:20.220340Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e337fd8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"34","timestamp":"2024-04-26T12:13:20.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:13:30.220527Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e395fb8e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"30","timestamp":"2024-04-26T12:13:30.220000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:252","timestamp":"2024-04-26T12:13:40.220667Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f8df4013190, domains=0x7f8e305f98e0, flags=0x3","pos":"virConnectListAllDomains:6961","subcomponent":"libvirt","thread":"32","timestamp":"2024-04-26T12:13:40.220000Z"}

alicefr · 2024-04-26T12:29:31Z

It seems to me that QEMU dies immediatly. Could please check the processes running in the container? If you add the annotation kubevirt.io/keep-launcher-alive-after-failure: "true", it should keep the pod running even after a failure.

jiangxiaobin96 · 2024-04-27T10:27:10Z

Containers are all running and get log from compute.

$ sudo crictl ps
CONTAINER           IMAGE               CREATED             STATE               NAME                       ATTEMPT             POD ID              POD
7aad545ccb204       89762a0ac7f70       2 minutes ago       Running             volumecontainerdisk        0                   bc7e1702b2430       virt-launcher-testvm-8b99t
2b3d9e4a94371       8941f55e28b98       2 minutes ago       Running             compute                    0                   bc7e1702b2430       virt-launcher-testvm-8b99t
88e700dc53933       a19df1d028d32       2 days ago          Running             virt-handler               0                   ce2baa6deb931       virt-handler-zgkjq
784223b0fe96c       cb1f903c6d9f2       2 days ago          Running             virt-controller            0                   f017ffcf51b8c       virt-controller-7f68fbd688-rmlsz
d9a3b441af4e2       6e7183afeefc2       2 days ago          Running             virt-api                   0                   4335a0e33d85d       virt-api-56fbd84dd5-b6tdd
9d7bf382c93d8       f4fc096cdc337       2 days ago          Running             virt-operator              0                   ae53f3ea141bd       virt-operator-8b8d65f8f-6ps6l

there is no virtqemud in my system. I refer issue946 to check. Is my libvirtd version too old. libvirtd --version = 6.0.0

Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/virtqemud-sock': No such file or directory')

alicefr · 2024-04-29T07:21:15Z

Containers are all running and get log from compute.

$ sudo crictl ps
CONTAINER           IMAGE               CREATED             STATE               NAME                       ATTEMPT             POD ID              POD
7aad545ccb204       89762a0ac7f70       2 minutes ago       Running             volumecontainerdisk        0                   bc7e1702b2430       virt-launcher-testvm-8b99t
2b3d9e4a94371       8941f55e28b98       2 minutes ago       Running             compute                    0                   bc7e1702b2430       virt-launcher-testvm-8b99t
88e700dc53933       a19df1d028d32       2 days ago          Running             virt-handler               0                   ce2baa6deb931       virt-handler-zgkjq
784223b0fe96c       cb1f903c6d9f2       2 days ago          Running             virt-controller            0                   f017ffcf51b8c       virt-controller-7f68fbd688-rmlsz
d9a3b441af4e2       6e7183afeefc2       2 days ago          Running             virt-api                   0                   4335a0e33d85d       virt-api-56fbd84dd5-b6tdd
9d7bf382c93d8       f4fc096cdc337       2 days ago          Running             virt-operator              0                   ae53f3ea141bd       virt-operator-8b8d65f8f-6ps6l

Here, I meant to exec in the compute container in virt-launcher pod and to run ps aux there.

there is no virtqemud in my system. I refer issue946 to check. Is my libvirtd version too old. libvirtd --version = 6.0.0
Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/virtqemud-sock': No such file or directory')

I'm a bit confused here. Libvirt is shipped with KubeVirt, so, this should't matter. virtqemud is part of the kubevirt release, it doesn't use the one from the host.

alicefr · 2024-04-29T09:01:22Z

@jiangxiaobin96 please share also the virt-handler logs

jiangxiaobin96 · 2024-04-29T14:33:26Z

log of ps aux in compute container

bash-5.1$ ps aux
USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
qemu           1  0.0  0.0 1761408 14212 ?       Ssl  14:34   0:00 /usr/bin/virt-launcher-monitor --qemu-timeout 250s --name testvm --uid ffbb826f-635f-46be-9fc1-8003462020c1 --namespace kubevirt --kubevirt-share-dir /var/run/kubevirt --ephemeral-disk-dir /var/run/kubevirt-ephemeral-disks --container-disk-dir /var/run/kubevirt/container-disks --grace-period-seconds 45 --hook-sidecars 0 --ovmf-path /usr/share/OVMF --run-as-nonroot
qemu          12  0.0  0.0 2707668 52704 ?       Sl   14:34   0:00 /usr/bin/virt-launcher --qemu-timeout 250s --name testvm --uid ffbb826f-635f-46be-9fc1-8003462020c1 --namespace kubevirt --kubevirt-share-dir /var/run/kubevirt --ephemeral-disk-dir /var/run/kubevirt-ephemeral-disks --container-disk-dir /var/run/kubevirt/container-disks --grace-period-seconds 45 --hook-sidecars 0 --ovmf-path /usr/share/OVMF --run-as-nonroot
qemu          30  0.0  0.0  31252 12568 ?        S    14:34   0:00 /usr/sbin/virtlogd -f /etc/libvirt/virtlogd.conf
qemu          31  0.0  0.0 1287248 18240 ?       Sl   14:34   0:00 /usr/sbin/virtqemud -f /var/run/libvirt/virtqemud.conf
qemu          59  0.0  0.0   4464  3768 pts/0    Ss+  14:35   0:00 bash
qemu          67  0.0  0.0   4464  3720 pts/1    Ss   14:36   0:00 bash
qemu          85  0.0  0.0   7160  2292 pts/1    R+   14:37   0:00 ps aux

virt-handler log
virt_handler_log.txt

alicefr · 2024-04-30T06:27:54Z

OK, there is a failure message in virt-handler:

{"component":"virt-handler","level":"error","msg":"cannot compute checksums as containerdisk/kernelboot containers seem to have been terminated","pos":"vm.go:936","timestamp":"2024-04-27T11:11:29.802668Z"}
{"component":"virt-handler","kind":"","level":"info","msg":"VMI is in phase: Failed | Domain does not exist","name":"testvm","namespace":"kubevirt","pos":"vm.go:1858","timestamp":"2024-04-27T11:11:29.812964Z","uid":"86c33329-7a26-46c6-ad31-6396c3bcd7b5"}

alicefr · 2024-04-30T06:39:02Z

@jiangxiaobin96 can you please check the directories /var/lib/kubelet and /var/lib/kubelet/pods if they are symlink?
Like ls -lsh /var/lib/kubelet

jiangxiaobin96 · 2024-05-03T01:58:59Z

test:/var/lib$ sudo ls -lsh kubelet/
total 28K
4.0K -rw-r--r-- 1 root root 1.1K Apr 21 20:52 config.yaml
4.0K drwxr-xr-x 2 root root 4.0K Apr 29 22:34 device-plugins
4.0K -rw-r--r-- 1 root root  173 Apr 21 20:52 kubeadm-flags.env
4.0K drwxr-xr-x 2 root root 4.0K Apr 21 20:52 pki
4.0K drwxr-xr-x 4 root root 4.0K Apr 27 22:04 plugins
4.0K drwxr-xr-x 2 root root 4.0K Apr 29 22:11 plugins_registry
4.0K drwxr-xr-x 2 root root 4.0K Apr 22 22:37 pods
test:/var/lib$ sudo ls -lsh kubelet/pods
total 0

ianb-mp · 2024-05-03T03:58:04Z

I had the same issue - same errors. In my case I'm using k0s which puts kubelet in a different location on the host. The fix for me was to create a bind mount as suggested in: #5913

I'm posting here as other k0s users may encounter the problem and see this issue/ticket first.

jiangxiaobin96 added the kind/bug label Apr 25, 2024

jiangxiaobin96 closed this as completed May 21, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

VirtualMachineInstance create failed #11787

VirtualMachineInstance create failed #11787

jiangxiaobin96 commented Apr 25, 2024

EdDev commented Apr 25, 2024

jiangxiaobin96 commented Apr 25, 2024 •

edited

alicefr commented Apr 26, 2024

jiangxiaobin96 commented Apr 26, 2024

alicefr commented Apr 26, 2024

jiangxiaobin96 commented Apr 27, 2024

alicefr commented Apr 29, 2024

alicefr commented Apr 29, 2024

jiangxiaobin96 commented Apr 29, 2024 •

edited

alicefr commented Apr 30, 2024

alicefr commented Apr 30, 2024

jiangxiaobin96 commented May 3, 2024

ianb-mp commented May 3, 2024

VirtualMachineInstance create failed #11787

VirtualMachineInstance create failed #11787

Comments

jiangxiaobin96 commented Apr 25, 2024

EdDev commented Apr 25, 2024

jiangxiaobin96 commented Apr 25, 2024 • edited

alicefr commented Apr 26, 2024

jiangxiaobin96 commented Apr 26, 2024

alicefr commented Apr 26, 2024

jiangxiaobin96 commented Apr 27, 2024

alicefr commented Apr 29, 2024

alicefr commented Apr 29, 2024

jiangxiaobin96 commented Apr 29, 2024 • edited

alicefr commented Apr 30, 2024

alicefr commented Apr 30, 2024

jiangxiaobin96 commented May 3, 2024

ianb-mp commented May 3, 2024

jiangxiaobin96 commented Apr 25, 2024 •

edited

jiangxiaobin96 commented Apr 29, 2024 •

edited