Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VM - console unavailable, no IP #11867

Open
BinaryPhinary opened this issue May 8, 2024 · 4 comments
Open

VM - console unavailable, no IP #11867

BinaryPhinary opened this issue May 8, 2024 · 4 comments
Labels

Comments

@BinaryPhinary
Copy link

BinaryPhinary commented May 8, 2024

What happened:

Method used:

I used a CDI import, which was then used to create a 'custom template vm', which was successful, and then cloned to create a VM - retaining the datavolume to use as an immutable object in the future from which to clone more versions. I have tried both NFS and iscsi backed storage. Both have the same result - which is a VM that appears to be running but is not pingable and cannot be console'd to

Baremetal cluster - 6 nodes

*** Please note - ignore any discrepancies in RAM. I tried one last attempt to keep the RAM consistent between the 'Template' version and the 'VM' version - reasoning that perhaps the 'change' the logs are complaining about is the resized RAM. This change did not 'fix' or 'resolve' the issue.

CDI used to upload Fedora-Cloud-Base-Generic.x86_64-40-1.14.qcow2 to a NFS PVC
default nfs-upload-pvc-golden Bound csi-521dedfdcc 220Gi RWO dc99-kn01-kubevirt-test

'Template' PVC and VMI created
default nfs-vmi-golden Bound csi-4b980f44ae 50Gi RWX dc99-kn01-kubevirt-test

'Template' vmi came up fine
NAMESPACE NAME AGE PHASE IP NODENAME READY
default golden-vmi 19s Running 10.233.68.39 xxxx-xxx-xxx-xxx True

'Template' vmi was pingable
PING 10.233.68.39 (10.233.68.39) 56(84) bytes of data.
64 bytes from 10.233.68.39: icmp_seq=1 ttl=63 time=0.396 ms
64 bytes from 10.233.68.39: icmp_seq=2 ttl=63 time=1.43 ms

'Template' vmi was able to receive a virt console and shutdown successfully
[ 127.260893] systemd-shutdown[1]: All filesystems unmounted.
[ 127.262425] systemd-shutdown[1]: Deactivating swaps.
[ 127.263573] systemd-shutdown[1]: All swaps deactivated.
[ 127.264736] systemd-shutdown[1]: Detaching loop devices.
[ 127.267454] systemd-shutdown[1]: All loop devices detached.
[ 127.268671] systemd-shutdown[1]: Stopping MD devices.
[ 127.269897] systemd-shutdown[1]: All MD devices stopped.
[ 127.271057] systemd-shutdown[1]: Detaching DM devices.
[ 127.272304] systemd-shutdown[1]: All DM devices detached.
[ 127.273470] systemd-shutdown[1]: All filesystems, swaps, loop devices, MD devices and DM devices detached.
[ 127.287215] systemd-shutdown[1]: Syncing filesystems and block devices.
[ 127.288833] systemd-shutdown[1]: Powering off.
[ 127.302423] ACPI: PM: Preparing to enter system sleep state S5
[ 127.305086] kvm: exiting hardware virtualization
[ 127.306085] reboot: Power down

'Template' VMI was removed
kubectl delete vm golden-vmi --cascade=orphan

'VM' PVC created to house the final 'customized vm'
default nfs-golden Bound csi-9873bf66d7 30Gi RWX dc99-kn01-kubevirt-test

'VM' came up - had ip assigned:
NAMESPACE NAME AGE PHASE IP NODENAME READY
default golden-vm 90m Running 10.233.68.40 xxxxxxxxxxxxxxxxxx True

'VM' Cannot be pinged:
PING 10.233.68.40 (10.233.68.40) 56(84) bytes of data.
From 10.92.152.65 icmp_seq=1 Destination Host Unreachable
From 10.92.152.65 icmp_seq=2 Destination Host Unreachable
From 10.92.152.65 icmp_seq=3 Destination Host Unreachable

'VM' cannot be console'd to:
Successfully connected to golden-vm console. The escape sequence is ^] (it hangs here)

'VM virt launcher logs show nothing of consequence that I see
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain defined.","name":"golden-vm","namespace":"default","pos":"manager.go:1076","timestamp":"2024-05-08T07:05:52.147294Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event Domain event="defined" detail="updated" with event id 0 reason 1 received","pos":"client.go:470","timestamp":"2024-05-08T07:05:52.147302Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Shutoff(5):Unknown(0)","pos":"client.go:297","timestamp":"2024-05-08T07:05:52.148894Z"}
{"component":"virt-launcher","level":"info","msg":"Domain name event: default_golden-vm","pos":"client.go:424","timestamp":"2024-05-08T07:05:52.149681Z"}
{"component":"virt-launcher","level":"info","msg":"generated nocloud iso file /var/run/kubevirt-ephemeral-disks/cloud-init-data/default/golden-vm/noCloud.iso","pos":"cloud-init.go:690","timestamp":"2024-05-08T07:05:52.255019Z"}
{"component":"virt-launcher","level":"info","msg":"GuestAgentLifecycle event state 2 with reason 1 received","pos":"client.go:546","timestamp":"2024-05-08T07:05:52.605270Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Paused(3):StartingUp(11)","pos":"client.go:297","timestamp":"2024-05-08T07:05:52.607196Z"}
{"component":"virt-launcher","level":"info","msg":"Domain name event: default_golden-vm","pos":"client.go:424","timestamp":"2024-05-08T07:05:52.608353Z"}
{"component":"virt-launcher","level":"info","msg":"2024-05-08 07:05:52.273+0000: starting up libvirt version: 9.5.0, package: 6.el9 (builder@centos.org, 2023-08-25-08:53:56, ), qemu version: 8.0.0qemu-kvm-8.0.0-13.el9, kernel: 5.15.0-200.131.27.el8uek.x86_64, hostname: golden-vm","subcomponent":"qemu","timestamp":"2024-05-08T07:05:52.699688Z"}
{"component":"virt-launcher","level":"info","msg":"LC_ALL=C \PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin \HOME=/home/qemu \XDG_CACHE_HOME=/var/run/kubevirt-private/libvirt/qemu/lib/domain-1-default_golden-vm/.cache \/usr/libexec/qemu-kvm \-name guest=default_golden-vm,debug-threads=on \-S \-object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/run/kubevirt-private/libvirt/qemu/lib/domain-1-default_golden-vm/master-key.aes"}' \-machine pc-q35-rhel9.2.0,usb=off,dump-guest-core=off,memory-backend=pc.ram,acpi=on \-accel kvm \-cpu SandyBridge-IBRS,vme=on,ss=on,vmx=on,pdcm=on,pcid=on,hypervisor=on,arat=on,tsc-adjust=on,umip=on,md-clear=on,stibp=on,arch-capabilities=on,ssbd=on,xsaveopt=on,pdpe1gb=on,ibpb=on,ibrs=on,amd-stibp=on,amd-ssbd=on,skip-l1dfl-vmentry=on,pschange-mc-no=on \-m size=2097152k \-object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":2147483648}' \-overcommit mem-lock=off \-smp 1,sockets=1,dies=1,cores=1,threads=1 \-object '{"qom-type":"iothread","id":"iothread1"}' \-uuid ebc6ef06-93f5-53cc-ac52-9ca8c0ff8f87 \-smbios type=1,manufacturer=KubeVirt,product=None,uuid=ebc6ef06-93f5-53cc-ac52-9ca8c0ff8f87,family=KubeVirt \-no-user-config \-nodefaults \-chardev socket,id=charmonitor,fd=20,server=on,wait=off \-mon chardev=charmonitor,id=monitor,mode=control \-rtc base=utc \-no-shutdown \-boot strict=on \-device '{"driver":"pcie-root-port","port":16,"chassis":1,"id":"pci.1","bus":"pcie.0","multifunction":true,"addr":"0x2"}' \-device '{"driver":"pcie-root-port","port":17,"chassis":2,"id":"pci.2","bus":"pcie.0","addr":"0x2.0x1"}' \-device '{"driver":"pcie-root-port","port":18,"chassis":3,"id":"pci.3","bus":"pcie.0","addr":"0x2.0x2"}' \-device '{"driver":"pcie-root-port","port":19,"chassis":4,"id":"pci.4","bus":"pcie.0","addr":"0x2.0x3"}' \-device '{"driver":"pcie-root-port","port":20,"chassis":5,"id":"pci.5","bus":"pcie.0","addr":"0x2.0x4"}' \-device '{"driver":"pcie-root-port","port":21,"chassis":6,"id":"pci.6","bus":"pcie.0","addr":"0x2.0x5"}' \-device '{"driver":"pcie-root-port","port":22,"chassis":7,"id":"pci.7","bus":"pcie.0","addr":"0x2.0x6"}' \-device '{"driver":"pcie-root-port","port":23,"chassis":8,"id":"pci.8","bus":"pcie.0","addr":"0x2.0x7"}' \-device '{"driver":"pcie-root-port","port":24,"chassis":9,"id":"pci.9","bus":"pcie.0","multifunction":true,"addr":"0x3"}' \-device '{"driver":"pcie-root-port","port":25,"chassis":10,"id":"pci.10","bus":"pcie.0","addr":"0x3.0x1"}' \-device '{"driver":"virtio-scsi-pci-non-transitional","id":"scsi0","bus":"pci.5","addr":"0x0"}' \-device '{"driver":"virtio-serial-pci-non-transitional","id":"virtio-serial0","bus":"pci.6","addr":"0x0"}' \-blockdev '{"driver":"file","filename":"/var/run/kubevirt-private/vmi-disks/datadisk1/disk.img","node-name":"libvirt-2-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \-blockdev '{"node-name":"libvirt-2-format","read-only":false,"discard":"unmap","cache":{"direct":true,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \-device '{"driver":"virtio-blk-pci-non-transitional","bus":"pci.7","addr":"0x0","drive":"libvirt-2-format","id":"ua-datadisk1","bootindex":1,"write-cache":"on","werror":"stop","rerror":"stop"}' \-blockdev '{"driver":"file","filename":"/var/run/kubevirt-ephemeral-disks/cloud-init-data/default/golden-vm/noCloud.iso","node-name":"libvirt-1-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \-blockdev '{"node-name":"libvirt-1-format","read-only":false,"discard":"unmap","cache":{"direct":true,"no-flush":false},"driver":"raw","file":"libvirt-1-storage"}' \-device '{"driver":"virtio-blk-pci-non-transitional","bus":"pci.8","addr":"0x0","drive":"libvirt-1-format","id":"ua-cloudinitdisk","write-cache":"on","werror":"stop","rerror":"stop"}' \-netdev '{"type":"tap","fd":"21","vhost":true,"vhostfd":"23","id":"hostua-default"}' \-device '{"driver":"virtio-net-pci-non-transitional","host_mtu":1500,"netdev":"hostua-default","id":"ua-default","mac":"96:a6:59:28:f5:0a","bus":"pci.1","addr":"0x0","romfile":""}' \-add-fd set=0,fd=19,opaque=serial0-log \-chardev socket,id=charserial0,fd=17,server=on,wait=off,logfile=/dev/fdset/0,logappend=on \-device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \-chardev socket,id=charchannel0,fd=18,server=on,wait=off \-device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \-audiodev '{"id":"audio1","driver":"none"}' \-vnc vnc=unix:/var/run/kubevirt-private/a1ad85ce-d8eb-4667-aa11-921164d47ab5/virt-vnc,audiodev=audio1 \-device '{"driver":"VGA","id":"video0","vgamem_mb":16,"bus":"pcie.0","addr":"0x1"}' \-global ICH9-LPC.noreboot=off \-watchdog-action reset \-device '{"driver":"virtio-balloon-pci-non-transitional","id":"balloon0","free-page-reporting":true,"bus":"pci.9","addr":"0x0"}' \-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \-msg timestamp=on","subcomponent":"qemu","timestamp":"2024-05-08T07:05:52.699858Z"}
{"component":"virt-launcher","level":"info","msg":"Found PID for default_golden-vm: 81","pos":"monitor.go:170","timestamp":"2024-05-08T07:05:53.102142Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event Domain event="resumed" detail="unpaused" with event id 4 reason 0 received","pos":"client.go:470","timestamp":"2024-05-08T07:05:53.286268Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event Domain event="started" detail="booted" with event id 2 reason 0 received","pos":"client.go:470","timestamp":"2024-05-08T07:05:53.306451Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain started.","name":"golden-vm","namespace":"default","pos":"manager.go:1104","timestamp":"2024-05-08T07:05:53.330105Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"golden-vm","namespace":"default","pos":"server.go:208","timestamp":"2024-05-08T07:05:53.331583Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:297","timestamp":"2024-05-08T07:05:53.331779Z"}
{"component":"virt-launcher","level":"info","msg":"Domain name event: default_golden-vm","pos":"client.go:424","timestamp":"2024-05-08T07:05:53.333085Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:297","timestamp":"2024-05-08T07:05:53.334834Z"}
{"component":"virt-launcher","level":"info","msg":"Domain name event: default_golden-vm","pos":"client.go:424","timestamp":"2024-05-08T07:05:53.335783Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"golden-vm","namespace":"default","pos":"server.go:208","timestamp":"2024-05-08T07:05:53.437396Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"golden-vm","namespace":"default","pos":"server.go:208","timestamp":"2024-05-08T07:05:53.585936Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"golden-vm","namespace":"default","pos":"server.go:208","timestamp":"2024-05-08T07:05:53.688700Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"golden-vm","namespace":"default","pos":"server.go:208","timestamp":"2024-05-08T07:08:44.157984Z","uid":"a1ad85ce-d8eb-4667-aa11-921164d47ab5"}

'VM' virt controller logs indicate that there was a change to the VM - this is the only error I could find
virt controller logs

{"component":"virt-controller","kind":"","level":"error","msg":"Updating the VirtualMachine status failed.","name":"golden-vm","namespace":"default","pos":"vm.go:386","reason":"Operation cannot be fulfilled on virtualmachines.kubevirt.io "golden-vm": the object has been modified; please apply your changes to the latest version and try again","timestamp":"2024-05-08T07:05:43.716306Z","uid":"c2a910d4-2c34-42b9-9537-2d06b42148e8"}
{"component":"virt-controller","level":"info","msg":"re-enqueuing VirtualMachine default/golden-vm","pos":"vm.go:280","reason":"Operation cannot be fulfilled on virtualmachines.kubevirt.io "golden-vm": the object has been modified; please apply your changes to the latest version and try again","timestamp":"2024-05-08T07:05:43.716341Z"}

kubectl get vm,vmi golden-vm -o yaml

apiVersion: v1
items:

  • apiVersion: kubevirt.io/v1
    kind: VirtualMachine
    metadata:
    annotations:
    kubevirt.io/latest-observed-api-version: v1
    kubevirt.io/storage-observed-api-version: v1
    creationTimestamp: "2024-05-08T07:15:14Z"
    finalizers:
    • kubevirt.io/virtualMachineControllerFinalize
      generation: 1
      labels:
      kubevirt.io/vm: golden-vm
      name: golden-vm
      namespace: default
      resourceVersion: "28814922"
      uid: 811be8fe-46d8-4beb-87b0-03106ed22dce
      spec:
      dataVolumeTemplates:
    • metadata:
      creationTimestamp: null
      name: nfs-golden
      spec:
      pvc:
      accessModes:
      - ReadWriteMany
      resources:
      requests:
      storage: 30Gi
      source:
      pvc:
      name: nfs-vmi-golden
      namespace: default
      running: true
      template:
      metadata:
      creationTimestamp: null
      labels:
      kubevirt.io/vm: golden-vm
      spec:
      architecture: amd64
      domain:
      devices:
      disks:
      - disk:
      bus: virtio
      name: datadisk1
      - disk:
      bus: virtio
      name: cloudinitdisk
      machine:
      type: q35
      resources:
      requests:
      memory: 1Gi
      terminationGracePeriodSeconds: 0
      volumes:
      • dataVolume:
        name: nfs-golden
        name: datadisk1
      • cloudInitNoCloud:
        userData: |
        # add any custom logic you want to occur on startup here.
        echo “cloud-init script execution"
        name: cloudinitdisk
        status:
        conditions:
    • lastProbeTime: null
      lastTransitionTime: "2024-05-08T07:15:12Z"
      status: "True"
      type: Ready
    • lastProbeTime: null
      lastTransitionTime: null
      status: "True"
      type: Initialized
    • lastProbeTime: null
      lastTransitionTime: null
      message: cannot migrate VMI which does not use masquerade, bridge with kubevirt.io/allow-pod-bridge-network-live-migration
      VM annotation or a migratable plugin to connect to the pod network
      reason: InterfaceNotLiveMigratable
      status: "False"
      type: LiveMigratable
      created: true
      desiredGeneration: 1
      observedGeneration: 1
      printableStatus: Running
      ready: true
      volumeSnapshotStatuses:
    • enabled: false
      name: datadisk1
      reason: 'No VolumeSnapshotClass: Volume snapshots are not configured for this
      StorageClass [dc99-kn01-kubevirt-test] [datadisk1]'
    • enabled: false
      name: cloudinitdisk
      reason: Snapshot is not supported for this volumeSource type [cloudinitdisk]
  • apiVersion: kubevirt.io/v1
    kind: VirtualMachineInstance
    metadata:
    annotations:
    kubevirt.io/latest-observed-api-version: v1
    kubevirt.io/storage-observed-api-version: v1
    kubevirt.io/vm-generation: "1"
    creationTimestamp: "2024-05-08T07:15:14Z"
    finalizers:
    • kubevirt.io/virtualMachineControllerFinalize
    • foregroundDeleteVirtualMachine
      generation: 9
      labels:
      kubevirt.io/nodeName: xxxxxxxxxxxxxxxxxx
      kubevirt.io/vm: golden-vm
      name: golden-vm
      namespace: default
      ownerReferences:
    • apiVersion: kubevirt.io/v1
      blockOwnerDeletion: true
      controller: true
      kind: VirtualMachine
      name: golden-vm
      uid: 811be8fe-46d8-4beb-87b0-03106ed22dce
      resourceVersion: "28814923"
      uid: e7ef236d-cdda-4213-8fb9-abf07a8c282d
      spec:
      architecture: amd64
      domain:
      cpu:
      cores: 1
      model: host-model
      sockets: 1
      threads: 1
      devices:
      disks:
      • disk:
        bus: virtio
        name: datadisk1
      • disk:
        bus: virtio
        name: cloudinitdisk
        interfaces:
      • bridge: {}
        name: default
        features:
        acpi:
        enabled: true
        firmware:
        uuid: ebc6ef06-93f5-53cc-ac52-9ca8c0ff8f87
        machine:
        type: q35
        resources:
        requests:
        memory: 1Gi
        evictionStrategy: None
        networks:
    • name: default
      pod: {}
      terminationGracePeriodSeconds: 0
      volumes:
    • dataVolume:
      name: nfs-golden
      name: datadisk1
    • cloudInitNoCloud:
      userData: |
      # add any custom logic you want to occur on startup here.
      echo “cloud-init script execution"
      name: cloudinitdisk
      status:
      activePods:
      3b36bea7-253c-43d6-93da-bc170475f34b: dc99-cb1-knw-003.dc99
      conditions:
    • lastProbeTime: null
      lastTransitionTime: "2024-05-08T07:15:12Z"
      status: "True"
      type: Ready
    • lastProbeTime: null
      lastTransitionTime: null
      message: cannot migrate VMI which does not use masquerade, bridge with kubevirt.io/allow-pod-bridge-network-live-migration
      VM annotation or a migratable plugin to connect to the pod network
      reason: InterfaceNotLiveMigratable
      status: "False"
      type: LiveMigratable
      currentCPUTopology:
      cores: 1
      sockets: 1
      threads: 1
      guestOSInfo: {}
      interfaces:
    • infoSource: domain
      ipAddress: 10.233.68.40
      ipAddresses:
      • 10.233.68.40
        mac: fe:20:ae:53:bf:ab
        name: default
        queueCount: 1
        launcherContainerImageVersion: quay.io/kubevirt/virt-launcher:v1.2.0
        machine:
        type: pc-q35-rhel9.2.0
        memory:
        guestCurrent: 1Gi
        migrationMethod: BlockMigration
        migrationTransport: Unix
        nodeName: dc99-cb1-knw-003.dc99
        phase: Running
        phaseTransitionTimestamps:
    • phase: Pending
      phaseTransitionTimestamp: "2024-05-08T07:15:00Z"
    • phase: Scheduling
      phaseTransitionTimestamp: "2024-05-08T07:15:00Z"
    • phase: Scheduled
      phaseTransitionTimestamp: "2024-05-08T07:15:12Z"
    • phase: Running
      phaseTransitionTimestamp: "2024-05-08T07:15:16Z"
      qosClass: Burstable
      runtimeUser: 107
      selinuxContext: none
      virtualMachineRevisionName: revision-start-vm-811be8fe-46d8-4beb-87b0-03106ed22dce-1
      volumeStatus:
    • name: cloudinitdisk
      size: 1048576
      target: vdb
    • name: datadisk1
      persistentVolumeClaimInfo:
      accessModes:
      • ReadWriteMany
        capacity:
        storage: 30Gi
        filesystemOverhead: "0.055"
        requests:
        storage: 30Gi
        volumeMode: Filesystem
        target: vda
        kind: List
        metadata:
        resourceVersion: ""

Looking at the container - the interface has the correct IP but it is down - Container and OS are accessible and functioning
sh-5.1$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0-nic@if305: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master k6t-eth0 state UP group default qlen 1000
link/ether d2:dd:cd:84:dc:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0
inet6 fe80::d0dd:cdff:fe84:dc1f/64 scope link
valid_lft forever preferred_lft forever
3: k6t-eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0a:bc:f1:d3:ec:48 brd ff:ff:ff:ff:ff:ff
inet 169.254.75.10/32 scope global k6t-eth0
valid_lft forever preferred_lft forever
inet6 fe80::d0dd:cdff:fe84:dc1f/64 scope link
valid_lft forever preferred_lft forever
4: tap0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master k6t-eth0 state UP group default qlen 1000
link/ether 0a:bc:f1:d3:ec:48 brd ff:ff:ff:ff:ff:ff
inet6 fe80::8bc:f1ff:fed3:ec48/64 scope link
valid_lft forever preferred_lft forever
5: eth0: <BROADCAST,NOARP> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether fe:20:ae:53:bf:ab brd ff:ff:ff:ff:ff:ff
inet 10.233.68.40/32 scope global eth0
valid_lft forever preferred_lft forever
inet6 fe80::fc20:aeff:fe53:bfab/64 scope link
valid_lft forever preferred_lft forever

Container info:

{
"ID": "5706a3b744fbbb078886134f1eb9725a217b1a64c0907dd9ab3c90482f6a4543",
"Labels": {
"io.cri-containerd.kind": "container",
"io.kubernetes.container.name": "compute",
"io.kubernetes.pod.name": "virt-launcher-golden-vm-s7n4k",
"io.kubernetes.pod.namespace": "default",
"io.kubernetes.pod.uid": "3b36bea7-253c-43d6-93da-bc170475f34b"
},
"Image": "quay.io/kubevirt/virt-launcher:v1.2.0",
"Runtime": {
"Name": "io.containerd.runc.v2",
"Options": {
"type_url": "containerd.runc.v1.Options",
"value": "MhMvdXNyL2xvY2FsL2Jpbi9ydW5jSAE="
}
},
"SnapshotKey": "5706a3b744fbbb078886134f1eb9725a217b1a64c0907dd9ab3c90482f6a4543",
"Snapshotter": "overlayfs",
"CreatedAt": "2024-05-08T07:15:11.976247642Z",
"UpdatedAt": "2024-05-08T07:15:11.976247642Z",
"Extensions": {
"io.cri-containerd.container.metadata": {
"type_url": "github.com/containerd/cri/pkg/store/container/Metadata",
"value": "eyJWZXJzaW9uIjoidjEiLCJNZXRhZGF0YSI6eyJJRCI6IjU3MDZhM2I3NDRmYmJiMDc4ODg2MTM0ZjFlYjk3MjVhMjE3YjFhNjRjMDkwN2RkOWFiM2M5MDQ4MmY2YTQ1NDMiLCJOYW1lIjoiY29tcHV0ZV92aXJ0LWxhdW5jaGVyLWdvbGRlbi12bS1zN240a19kZWZhdWx0XzNiMzZiZWE3LTI1M2MtNDNkNi05M2RhLWJjMTcwNDc1ZjM0Yl8wIiwiU2FuZGJveElEIjoiZDdhZDY3NWY2ZjVkNmZiN2ZjODg4YTNjOWRmMWZkMmRiMWQxYTNkMmZlNTJhMjQxYjExNWI1OGUyMTcxY2M3MCIsIkNvbmZpZyI6eyJtZXRhZGF0YSI6eyJuYW1lIjoiY29tcHV0ZSJ9LCJpbWFnZSI6eyJpbWFnZSI6InNoYTI1NjozM2I3YzMxZTc5YTAxNWEzYmIxZDJmNDQ0MTM4YWRiNzhkMDg5ZDU3NmE3YzQwNGE2NDY4ZTVmN2ZjYjE0MWMyIn0sImNvbW1hbmQiOlsiL3Vzci9iaW4vdmlydC1sYXVuY2hlci1tb25pdG9yIiwiLS1xZW11LXRpbWVvdXQiLCIzNTVzIiwiLS1uYW1lIiwiZ29sZGVuLXZtIiwiLS11aWQiLCJlN2VmMjM2ZC1jZGRhLTQyMTMtOGZiOS1hYmYwN2E4YzI4MmQiLCItLW5hbWVzcGFjZSIsImRlZmF1bHQiLCItLWt1YmV2aXJ0LXNoYXJlLWRpciIsIi92YXIvcnVuL2t1YmV2aXJ0IiwiLS1lcGhlbWVyYWwtZGlzay1kaXIiLCIvdmFyL3J1bi9rdWJldmlydC1lcGhlbWVyYWwtZGlza3MiLCItLWNvbnRhaW5lci1kaXNrLWRpciIsIi92YXIvcnVuL2t1YmV2aXJ0L2NvbnRhaW5lci1kaXNrcyIsIi0tZ3JhY2UtcGVyaW9kLXNlY29uZHMiLCIxNSIsIi0taG9vay1zaWRlY2FycyIsIjAiLCItLW92bWYtcGF0aCIsIi91c3Ivc2hhcmUvT1ZNRiIsIi0tcnVuLWFzLW5vbnJvb3QiXSwiZW52cyI6W3sia2V5IjoiWERHX0NBQ0hFX0hPTUUiLCJ2YWx1ZSI6Ii92YXIvcnVuL2t1YmV2aXJ0LXByaXZhdGUifSx7ImtleSI6IlhER19DT05GSUdfSE9NRSIsInZhbHVlIjoiL3Zhci9ydW4va3ViZXZpcnQtcHJpdmF0ZSJ9LHsia2V5IjoiWERHX1JVTlRJTUVfRElSIiwidmFsdWUiOiIvdmFyL3J1biJ9LHsia2V5IjoiUE9EX05BTUUiLCJ2YWx1ZSI6InZpcnQtbGF1bmNoZXItZ29sZGVuLXZtLXM3bjRrIn0seyJrZXkiOiJLVUJFUk5FVEVTX1NFUlZJQ0VfUE9SVF9IVFRQUyIsInZhbHVlIjoiNDQzIn0seyJrZXkiOiJLVUJFUk5FVEVTX1BPUlQiLCJ2YWx1ZSI6InRjcDovLzEwLjIzMy4wLjE6NDQzIn0seyJrZXkiOiJLVUJFUk5FVEVTX1BPUlRfNDQzX1RDUCIsInZhbHVlIjoidGNwOi8vMTAuMjMzLjAuMTo0NDMifSx7ImtleSI6IktVQkVSTkVURVNfUE9SVF80NDNfVENQX1BST1RPIiwidmFsdWUiOiJ0Y3AifSx7ImtleSI6IktVQkVSTkVURVNfUE9SVF80NDNfVENQX1BPUlQiLCJ2YWx1ZSI6IjQ0MyJ9LHsia2V5IjoiS1VCRVJORVRFU19QT1JUXzQ0M19UQ1BfQUREUiIsInZhbHVlIjoiMTAuMjMzLjAuMSJ9LHsia2V5IjoiS1VCRVJORVRFU19TRVJWSUNFX0hPU1QiLCJ2YWx1ZSI6IjEwLjIzMy4wLjEifSx7ImtleSI6IktVQkVSTkVURVNfU0VSVklDRV9QT1JUIiwidmFsdWUiOiI0NDMifV0sIm1vdW50cyI6W3siY29udGFpbmVyX3BhdGgiOiIvdmFyL3J1bi9rdWJldmlydC1wcml2YXRlIiwiaG9zdF9wYXRoIjoiL3Zhci9saWIva3ViZWxldC9wb2RzLzNiMzZiZWE3LTI1M2MtNDNkNi05M2RhLWJjMTcwNDc1ZjM0Yi92b2x1bWVzL2t1YmVybmV0ZXMuaW9+ZW1wdHktZGlyL3ByaXZhdGUifSx7ImNvbnRhaW5lcl9wYXRoIjoiL3Zhci9ydW4va3ViZXZpcnQiLCJob3N0X3BhdGgiOiIvdmFyL2xpYi9rdWJlbGV0L3BvZHMvM2IzNmJlYTctMjUzYy00M2Q2LTkzZGEtYmMxNzA0NzVmMzRiL3ZvbHVtZXMva3ViZXJuZXRlcy5pb35lbXB0eS1kaXIvcHVibGljIn0seyJjb250YWluZXJfcGF0aCI6Ii92YXIvcnVuL2t1YmV2aXJ0LWVwaGVtZXJhbC1kaXNrcyIsImhvc3RfcGF0aCI6Ii92YXIvbGliL2t1YmVsZXQvcG9kcy8zYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIvdm9sdW1lcy9rdWJlcm5ldGVzLmlvfmVtcHR5LWRpci9lcGhlbWVyYWwtZGlza3MifSx7ImNvbnRhaW5lcl9wYXRoIjoiL3Zhci9ydW4va3ViZXZpcnQvY29udGFpbmVyLWRpc2tzIiwiaG9zdF9wYXRoIjoiL3Zhci9saWIva3ViZWxldC9wb2RzLzNiMzZiZWE3LTI1M2MtNDNkNi05M2RhLWJjMTcwNDc1ZjM0Yi92b2x1bWVzL2t1YmVybmV0ZXMuaW9+ZW1wdHktZGlyL2NvbnRhaW5lci1kaXNrcyIsInByb3BhZ2F0aW9uIjoxfSx7ImNvbnRhaW5lcl9wYXRoIjoiL3Zhci9ydW4vbGlidmlydCIsImhvc3RfcGF0aCI6Ii92YXIvbGliL2t1YmVsZXQvcG9kcy8zYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIvdm9sdW1lcy9rdWJlcm5ldGVzLmlvfmVtcHR5LWRpci9saWJ2aXJ0LXJ1bnRpbWUifSx7ImNvbnRhaW5lcl9wYXRoIjoiL3Zhci9ydW4va3ViZXZpcnQvc29ja2V0cyIsImhvc3RfcGF0aCI6Ii92YXIvbGliL2t1YmVsZXQvcG9kcy8zYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIvdm9sdW1lcy9rdWJlcm5ldGVzLmlvfmVtcHR5LWRpci9zb2NrZXRzIn0seyJjb250YWluZXJfcGF0aCI6Ii92YXIvcnVuL2t1YmV2aXJ0LXByaXZhdGUvdm1pLWRpc2tzL2RhdGFkaXNrMSIsImhvc3RfcGF0aCI6Ii92YXIvbGliL2t1YmVsZXQvcG9kcy8zYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIvdm9sdW1lcy9rdWJlcm5ldGVzLmlvfmNzaS9jc2ktMzBhYzU1NjY5NC9tb3VudCJ9LHsiY29udGFpbmVyX3BhdGgiOiIvdmFyL3J1bi9rdWJldmlydC9ob3RwbHVnLWRpc2tzIiwiaG9zdF9wYXRoIjoiL3Zhci9saWIva3ViZWxldC9wb2RzLzNiMzZiZWE3LTI1M2MtNDNkNi05M2RhLWJjMTcwNDc1ZjM0Yi92b2x1bWVzL2t1YmVybmV0ZXMuaW9+ZW1wdHktZGlyL2hvdHBsdWctZGlza3MiLCJwcm9wYWdhdGlvbiI6MX0seyJjb250YWluZXJfcGF0aCI6Ii9ldGMvaG9zdHMiLCJob3N0X3BhdGgiOiIvdmFyL2xpYi9rdWJlbGV0L3BvZHMvM2IzNmJlYTctMjUzYy00M2Q2LTkzZGEtYmMxNzA0NzVmMzRiL2V0Yy1ob3N0cyJ9LHsiY29udGFpbmVyX3BhdGgiOiIvZGV2L3Rlcm1pbmF0aW9uLWxvZyIsImhvc3RfcGF0aCI6Ii92YXIvbGliL2t1YmVsZXQvcG9kcy8zYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIvY29udGFpbmVycy9jb21wdXRlLzFhMzk2YTM2In1dLCJkZXZpY2VzIjpbeyJjb250YWluZXJfcGF0aCI6Ii9kZXYva3ZtIiwiaG9zdF9wYXRoIjoiL2Rldi9rdm0iLCJwZXJtaXNzaW9ucyI6InJ3In0seyJjb250YWluZXJfcGF0aCI6Ii9kZXYvbmV0L3R1biIsImhvc3RfcGF0aCI6Ii9kZXYvbmV0L3R1biIsInBlcm1pc3Npb25zIjoicncifSx7ImNvbnRhaW5lcl9wYXRoIjoiL2Rldi92aG9zdC1uZXQiLCJob3N0X3BhdGgiOiIvZGV2L3Zob3N0LW5ldCIsInBlcm1pc3Npb25zIjoicncifV0sImxhYmVscyI6eyJpby5rdWJlcm5ldGVzLmNvbnRhaW5lci5uYW1lIjoiY29tcHV0ZSIsImlvLmt1YmVybmV0ZXMucG9kLm5hbWUiOiJ2aXJ0LWxhdW5jaGVyLWdvbGRlbi12bS1zN240ayIsImlvLmt1YmVybmV0ZXMucG9kLm5hbWVzcGFjZSI6ImRlZmF1bHQiLCJpby5rdWJlcm5ldGVzLnBvZC51aWQiOiIzYjM2YmVhNy0yNTNjLTQzZDYtOTNkYS1iYzE3MDQ3NWYzNGIifSwiYW5ub3RhdGlvbnMiOnsiaW8ua3ViZXJuZXRlcy5jb250YWluZXIuaGFzaCI6IjVhZTExNWFiIiwiaW8ua3ViZXJuZXRlcy5jb250YWluZXIucmVzdGFydENvdW50IjoiMCIsImlvLmt1YmVybmV0ZXMuY29udGFpbmVyLnRlcm1pbmF0aW9uTWVzc2FnZVBhdGgiOiIvZGV2L3Rlcm1pbmF0aW9uLWxvZyIsImlvLmt1YmVybmV0ZXMuY29udGFpbmVyLnRlcm1pbmF0aW9uTWVzc2FnZVBvbGljeSI6IkZpbGUiLCJpby5rdWJlcm5ldGVzLnBvZC50ZXJtaW5hdGlvbkdyYWNlUGVyaW9kIjoiMzAifSwibG9nX3BhdGgiOiJjb21wdXRlLzAubG9nIiwibGludXgiOnsicmVzb3VyY2VzIjp7ImNwdV9wZXJpb2QiOjEwMDAwMCwiY3B1X3NoYXJlcyI6MTAyLCJvb21fc2NvcmVfYWRqIjo5OTEsImh1Z2VwYWdlX2xpbWl0cyI6W3sicGFnZV9zaXplIjoiMk1CIn0seyJwYWdlX3NpemUiOiIxR0IifV19LCJzZWN1cml0eV9jb250ZXh0Ijp7ImNhcGFiaWxpdGllcyI6eyJhZGRfY2FwYWJpbGl0aWVzIjpbIk5FVF9CSU5EX1NFUlZJQ0UiXSwiZHJvcF9jYXBhYmlsaXRpZXMiOlsiQUxMIl19LCJuYW1lc3BhY2Vfb3B0aW9ucyI6eyJwaWQiOjF9LCJydW5fYXNfdXNlciI6eyJ2YWx1ZSI6MTA3fSwicnVuX2FzX2dyb3VwIjp7InZhbHVlIjoxMDd9LCJzdXBwbGVtZW50YWxfZ3JvdXBzIjpbMTA3XSwibm9fbmV3X3ByaXZzIjp0cnVlLCJtYXNrZWRfcGF0aHMiOlsiL3Byb2MvYXNvdW5kIiwiL3Byb2MvYWNwaSIsIi9wcm9jL2tjb3JlIiwiL3Byb2Mva2V5cyIsIi9wcm9jL2xhdGVuY3lfc3RhdHMiLCIvcHJvYy90aW1lcl9saXN0IiwiL3Byb2MvdGltZXJfc3RhdHMiLCIvcHJvYy9zY2hlZF9kZWJ1ZyIsIi9wcm9jL3Njc2kiLCIvc3lzL2Zpcm13YXJlIl0sInJlYWRvbmx5X3BhdGhzIjpbIi9wcm9jL2J1cyIsIi9wcm9jL2ZzIiwiL3Byb2MvaXJxIiwiL3Byb2Mvc3lzIiwiL3Byb2Mvc3lzcnEtdHJpZ2dlciJdLCJzZWNjb21wIjp7InByb2ZpbGVfdHlwZSI6MX19fX0sIkltYWdlUmVmIjoic2hhMjU2OjMzYjdjMzFlNzlhMDE1YTNiYjFkMmY0NDQxMzhhZGI3OGQwODlkNTc2YTdjNDA0YTY0NjhlNWY3ZmNiMTQxYzIiLCJMb2dQYXRoIjoiL3Zhci9sb2cvcG9kcy9kZWZhdWx0X3ZpcnQtbGF1bmNoZXItZ29sZGVuLXZtLXM3bjRrXzNiMzZiZWE3LTI1M2MtNDNkNi05M2RhLWJjMTcwNDc1ZjM0Yi9jb21wdXRlLzAubG9nIiwiU3RvcFNpZ25hbCI6IiIsIlByb2Nlc3NMYWJlbCI6IiJ9fQ=="
}
},
"SandboxID": "",
"Spec": {
"ociVersion": "1.1.0",
"process": {
"user": {
"uid": 107,
"gid": 107,
"additionalGids": [
107
]
},
"args": [
"/usr/bin/virt-launcher-monitor",
"--qemu-timeout",
"355s",
"--name",
"golden-vm",
"--uid",
"e7ef236d-cdda-4213-8fb9-abf07a8c282d",
"--namespace",
"default",
"--kubevirt-share-dir",
"/var/run/kubevirt",
"--ephemeral-disk-dir",
"/var/run/kubevirt-ephemeral-disks",
"--container-disk-dir",
"/var/run/kubevirt/container-disks",
"--grace-period-seconds",
"15",
"--hook-sidecars",
"0",
"--ovmf-path",
"/usr/share/OVMF",
"--run-as-nonroot"
],
"env": [
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"HOSTNAME=golden-vm",
"XDG_CACHE_HOME=/var/run/kubevirt-private",
"XDG_CONFIG_HOME=/var/run/kubevirt-private",
"XDG_RUNTIME_DIR=/var/run",
"POD_NAME=virt-launcher-golden-vm-s7n4k",
"KUBERNETES_SERVICE_PORT_HTTPS=443",
"KUBERNETES_PORT=tcp://10.233.0.1:443",
"KUBERNETES_PORT_443_TCP=tcp://10.233.0.1:443",
"KUBERNETES_PORT_443_TCP_PROTO=tcp",
"KUBERNETES_PORT_443_TCP_PORT=443",
"KUBERNETES_PORT_443_TCP_ADDR=10.233.0.1",
"KUBERNETES_SERVICE_HOST=10.233.0.1",
"KUBERNETES_SERVICE_PORT=443"
],
"cwd": "/",
"capabilities": {
"bounding": [
"CAP_NET_BIND_SERVICE"
],
"effective": [
"CAP_NET_BIND_SERVICE"
],
"permitted": [
"CAP_NET_BIND_SERVICE"
]
},
"rlimits": [
{
"type": "RLIMIT_NOFILE",
"hard": 65535,
"soft": 65535
}
],
"noNewPrivileges": true,
"oomScoreAdj": 991
},
"root": {
"path": "rootfs"
},
"mounts": [
{
"destination": "/proc",
"type": "proc",
"source": "proc",
"options": [
"nosuid",
"noexec",
"nodev"
]
},
{
"destination": "/dev",
"type": "tmpfs",
"source": "tmpfs",
"options": [
"nosuid",
"strictatime",
"mode=755",
"size=65536k"
]
},
{
"destination": "/dev/pts",
"type": "devpts",
"source": "devpts",
"options": [
"nosuid",
"noexec",
"newinstance",
"ptmxmode=0666",
"mode=0620",
"gid=5"
]
},
{
"destination": "/dev/mqueue",
"type": "mqueue",
"source": "mqueue",
"options": [
"nosuid",
"noexec",
"nodev"
]
},
{
"destination": "/sys",
"type": "sysfs",
"source": "sysfs",
"options": [
"nosuid",
"noexec",
"nodev",
"ro"
]
},
{
"destination": "/sys/fs/cgroup",
"type": "cgroup",
"source": "cgroup",
"options": [
"nosuid",
"noexec",
"nodev",
"relatime",
"ro"
]
},
{
"destination": "/etc/hosts",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/etc-hosts",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/dev/termination-log",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/containers/compute/1a396a36",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/etc/hostname",
"type": "bind",
"source": "/var/lib/containerd/io.containerd.grpc.v1.cri/sandboxes/d7ad675f6f5d6fb7fc888a3c9df1fd2db1d1a3d2fe52a241b115b58e2171cc70/hostname",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/etc/resolv.conf",
"type": "bind",
"source": "/var/lib/containerd/io.containerd.grpc.v1.cri/sandboxes/d7ad675f6f5d6fb7fc888a3c9df1fd2db1d1a3d2fe52a241b115b58e2171cc70/resolv.conf",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/dev/shm",
"type": "bind",
"source": "/run/containerd/io.containerd.grpc.v1.cri/sandboxes/d7ad675f6f5d6fb7fc888a3c9df1fd2db1d1a3d2fe52a241b115b58e2171cc70/shm",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/kubevirt-private",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.ioempty-dir/private",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/kubevirt",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.io
empty-dir/public",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/kubevirt-ephemeral-disks",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.ioempty-dir/ephemeral-disks",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/libvirt",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.io
empty-dir/libvirt-runtime",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/kubevirt/container-disks",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.ioempty-dir/container-disks",
"options": [
"rbind",
"rslave",
"rw"
]
},
{
"destination": "/var/run/kubevirt/sockets",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.io
empty-dir/sockets",
"options": [
"rbind",
"rprivate",
"rw"
]
},
{
"destination": "/var/run/kubevirt/hotplug-disks",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.ioempty-dir/hotplug-disks",
"options": [
"rbind",
"rslave",
"rw"
]
},
{
"destination": "/var/run/kubevirt-private/vmi-disks/datadisk1",
"type": "bind",
"source": "/var/lib/kubelet/pods/3b36bea7-253c-43d6-93da-bc170475f34b/volumes/kubernetes.io
csi/csi-30ac556694/mount",
"options": [
"rbind",
"rprivate",
"rw"
]
}
],
"annotations": {
"io.kubernetes.cri.container-name": "compute",
"io.kubernetes.cri.container-type": "container",
"io.kubernetes.cri.image-name": "quay.io/kubevirt/virt-launcher:v1.2.0",
"io.kubernetes.cri.sandbox-id": "d7ad675f6f5d6fb7fc888a3c9df1fd2db1d1a3d2fe52a241b115b58e2171cc70",
"io.kubernetes.cri.sandbox-name": "virt-launcher-golden-vm-s7n4k",
"io.kubernetes.cri.sandbox-namespace": "default",
"io.kubernetes.cri.sandbox-uid": "3b36bea7-253c-43d6-93da-bc170475f34b"
},
"linux": {
"resources": {
"devices": [
{
"allow": false,
"access": "rwm"
},
{
"allow": true,
"type": "c",
"major": 10,
"minor": 232,
"access": "rw"
},
{
"allow": true,
"type": "c",
"major": 10,
"minor": 200,
"access": "rw"
},
{
"allow": true,
"type": "c",
"major": 10,
"minor": 238,
"access": "rw"
}
],
"memory": {},
"cpu": {
"shares": 102,
"period": 100000
}
},
"cgroupsPath": "kubepods-burstable-pod3b36bea7_253c_43d6_93da_bc170475f34b.slice:cri-containerd:5706a3b744fbbb078886134f1eb9725a217b1a64c0907dd9ab3c90482f6a4543",
"namespaces": [
{
"type": "pid"
},
{
"type": "ipc",
"path": "/proc/177000/ns/ipc"
},
{
"type": "uts",
"path": "/proc/177000/ns/uts"
},
{
"type": "mount"
},
{
"type": "network",
"path": "/proc/177000/ns/net"
}
],
"devices": [
{
"path": "/dev/kvm",
"type": "c",
"major": 10,
"minor": 232,
"fileMode": 438,
"uid": 107,
"gid": 107
},
{
"path": "/dev/net/tun",
"type": "c",
"major": 10,
"minor": 200,
"fileMode": 438,
"uid": 107,
"gid": 107
},
{
"path": "/dev/vhost-net",
"type": "c",
"major": 10,
"minor": 238,
"fileMode": 384,
"uid": 107,
"gid": 107
}
],
"rootfsPropagation": "rslave",
"maskedPaths": [
"/proc/asound",
"/proc/acpi",
"/proc/kcore",
"/proc/keys",
"/proc/latency_stats",
"/proc/timer_list",
"/proc/timer_stats",
"/proc/sched_debug",
"/proc/scsi",
"/sys/firmware"
],
"readonlyPaths": [
"/proc/bus",
"/proc/fs",
"/proc/irq",
"/proc/sys",
"/proc/sysrq-trigger"
]
}
}

XML Below

What you expected to happen:
I expected that the cloned VM would come up with an IP address which could be pinged and also to be able to console to the vm.

How to reproduce it (as minimally and precisely as possible):
Steps are above - it can be reproduced in my environment quite easily. After well over 20-30 tries - the results are always the same - ISCSI, NFS, the same namespace, different namespaces etc

Additional context:
Add any other context about the problem here.

Environment:

  • KubeVirt version (use virtctl version):
  • Client Version: version.Info{GitVersion:"v1.2.0", GitCommit:"f26e45d99ac35743fc33d6a121b629e9a9af6b63", GitTreeState:"clean", BuildDate:"2024-03-05T20:34:24Z", GoVersion:"go1.21.5 X:nocoverageredesign", Compiler:"gc", Platform:"linux/amd64"}
    Server Version: version.Info{GitVersion:"v1.2.0", GitCommit:"f26e45d99ac35743fc33d6a121b629e9a9af6b63", GitTreeState:"clean", BuildDate:"2024-03-05T21:32:21Z", GoVersion:"go1.21.5 X:nocoverageredesign", Compiler:"gc", Platform:"linux/amd64"}
  • Kubernetes version (use kubectl version):
  • Kubectl version
    Client Version: v1.29.3
    Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
    Server Version: v1.29.3
  • VM or VMI specifications: Provided above
  • Cloud provider or hardware configuration: On-Prem - bare metal
  • OS (e.g. from /etc/os-release): Oracle Linux Server release 8.9
  • Kernel (e.g. uname -a):
    5.15.0-200.131.27.el8uek.x86_64 Unit tests are very slow #2 SMP Wed Oct 4 22:19:10 PDT 2023 x86_64 x86_64 x86_64 GNU/Linux
  • Install tools: N/A
  • Others: N/A
@BinaryPhinary
Copy link
Author

<domain type='kvm' id='1'> <name>default_golden-vm</name> <uuid>ebc6ef06-93f5-53cc-ac52-9ca8c0ff8f87</uuid> <metadata> <kubevirt xmlns="http://kubevirt.io"> <uid/> </kubevirt> </metadata> <memory unit='KiB'>1048576</memory> <currentMemory unit='KiB'>1048576</currentMemory> <vcpu placement='static'>1</vcpu> <iothreads>1</iothreads> <sysinfo type='smbios'> <system> <entry name='manufacturer'>KubeVirt</entry> <entry name='product'>None</entry> <entry name='uuid'>ebc6ef06-93f5-53cc-ac52-9ca8c0ff8f87</entry> <entry name='family'>KubeVirt</entry> </system> </sysinfo> <os> <type arch='x86_64' machine='pc-q35-rhel9.2.0'>hvm</type> <boot dev='hd'/> <smbios mode='sysinfo'/> </os> <features> <acpi/> </features> <cpu mode='custom' match='exact' check='full'> <model fallback='forbid'>SandyBridge-IBRS</model> <vendor>Intel</vendor> <topology sockets='1' dies='1' cores='1' threads='1'/> <feature policy='require' name='vme'/> <feature policy='require' name='ss'/> <feature policy='require' name='vmx'/> <feature policy='require' name='pdcm'/> <feature policy='require' name='pcid'/> <feature policy='require' name='hypervisor'/> <feature policy='require' name='arat'/> <feature policy='require' name='tsc_adjust'/> <feature policy='require' name='umip'/> <feature policy='require' name='md-clear'/> <feature policy='require' name='stibp'/> <feature policy='require' name='arch-capabilities'/> <feature policy='require' name='ssbd'/> <feature policy='require' name='xsaveopt'/> <feature policy='require' name='pdpe1gb'/> <feature policy='require' name='ibpb'/> <feature policy='require' name='ibrs'/> <feature policy='require' name='amd-stibp'/> <feature policy='require' name='amd-ssbd'/> <feature policy='require' name='skip-l1dfl-vmentry'/> <feature policy='require' name='pschange-mc-no'/> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/libexec/qemu-kvm</emulator> <disk type='file' device='disk' model='virtio-non-transitional'> <driver name='qemu' type='raw' cache='none' error_policy='stop' discard='unmap'/> <source file='/var/run/kubevirt-private/vmi-disks/datadisk1/disk.img' index='2'/> <backingStore/> <target dev='vda' bus='virtio'/> <alias name='ua-datadisk1'/> <address type='pci' domain='0x0000' bus='0x07' slot='0x00' function='0x0'/> </disk> <disk type='file' device='disk' model='virtio-non-transitional'> <driver name='qemu' type='raw' cache='none' error_policy='stop' discard='unmap'/> <source file='/var/run/kubevirt-ephemeral-disks/cloud-init-data/default/golden-vm/noCloud.iso' index='1'/> <backingStore/> <target dev='vdb' bus='virtio'/> <alias name='ua-cloudinitdisk'/> <address type='pci' domain='0x0000' bus='0x08' slot='0x00' function='0x0'/> </disk> <controller type='usb' index='0' model='none'> <alias name='usb'/> </controller> <controller type='scsi' index='0' model='virtio-non-transitional'> <alias name='scsi0'/> <address type='pci' domain='0x0000' bus='0x05' slot='0x00' function='0x0'/> </controller> <controller type='virtio-serial' index='0' model='virtio-non-transitional'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </controller> <controller type='sata' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'> <alias name='pcie.0'/> </controller> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x10'/> <alias name='pci.1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x11'/> <alias name='pci.2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x1'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0x12'/> <alias name='pci.3'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='4' port='0x13'/> <alias name='pci.4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/> </controller> <controller type='pci' index='5' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='5' port='0x14'/> <alias name='pci.5'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/> </controller> <controller type='pci' index='6' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='6' port='0x15'/> <alias name='pci.6'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x5'/> </controller> <controller type='pci' index='7' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='7' port='0x16'/> <alias name='pci.7'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x6'/> </controller> <controller type='pci' index='8' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='8' port='0x17'/> <alias name='pci.8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x7'/> </controller> <controller type='pci' index='9' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='9' port='0x18'/> <alias name='pci.9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='10' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='10' port='0x19'/> <alias name='pci.10'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x1'/> </controller> <interface type='ethernet'> <mac address='fe:20:ae:53:bf:ab'/> <target dev='tap0' managed='no'/> <model type='virtio-non-transitional'/> <mtu size='1500'/> <alias name='ua-default'/> <rom enabled='no'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='unix'> <source mode='bind' path='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-serial0'/> <log file='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-serial0-log' append='on'/> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> <alias name='serial0'/> </serial> <console type='unix'> <source mode='bind' path='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-serial0'/> <log file='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-serial0-log' append='on'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/run/kubevirt-private/libvirt/qemu/channel/target/domain-1-default_golden-vm/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <input type='mouse' bus='ps2'> <alias name='input0'/> </input> <input type='keyboard' bus='ps2'> <alias name='input1'/> </input> <graphics type='vnc' socket='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-vnc'> <listen type='socket' socket='/var/run/kubevirt-private/e7ef236d-cdda-4213-8fb9-abf07a8c282d/virt-vnc'/> </graphics> <audio id='1' type='none'/> <video> <model type='vga' vram='16384' heads='1' primary='yes'/> <alias name='video0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/> </video> <watchdog model='itco' action='reset'> <alias name='watchdog0'/> </watchdog> <memballoon model='virtio-non-transitional' freePageReporting='on'> <stats period='10'/> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x09' slot='0x00' function='0x0'/> </memballoon> </devices> </domain>

@aburdenthehand
Copy link
Contributor

/cc @EdDev

@EdDev
Copy link
Member

EdDev commented May 9, 2024

@BinaryPhinary , I cannot see anything wrong from the Kubvirt side.
But it is also hard to view the logs you posted.

It is odd that you cannot access its console. How did you try to do that?

@BinaryPhinary
Copy link
Author

BinaryPhinary commented May 9, 2024

@BinaryPhinary , I cannot see anything wrong from the Kubvirt side. But it is also hard to view the logs you posted.

It is odd that you cannot access its console. How did you try to do that?

Two methods - I used kubectl virt console

I also installed as part of the creation of the 'Template' virt-viewer so that I could attempt to use vnc. This also fails with the following message:

{"component":"","level":"info","msg":"--proxy-only is set to false, listening on 127.0.0.1\n","pos":"vnc.go:116","timestamp":"2024-05-09T10:04:17.651804Z"}
{"component":"","level":"info","msg":"connection timeout: 1m0s","pos":"vnc.go:157","timestamp":"2024-05-09T10:04:17.652406Z"}
Error encountered: could not find remote-viewer or vncviewer binary in $PATH

I suppose this is not surprising given that I cant ping the cloned vm either. The 'Tempate' VM I can ping and console to just fine.

Is there another format I can supply that logs that would be easier? Perhaps in a text notepad? And which ones would you like? Happy to get them in a format that will help

The other thing I found interesting - but Im not clear on what the bearing is on the issues - that the XML seems to reference tap0 as the interface - which has no IP address. The IP is on the eth0 address, which is not referenced by the XML.

4: tap0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master k6t-eth0 state UP group default qlen 1000
link/ether 0a:bc:f1:d3:ec:48 brd ff:ff:ff:ff:ff:ff
inet6 fe80::8bc:f1ff:fed3:ec48/64 scope link
valid_lft forever preferred_lft forever
5: eth0: <BROADCAST,NOARP> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether fe:20:ae:53:bf:ab brd ff:ff:ff:ff:ff:ff
inet 10.233.68.40/32 scope global eth0
valid_lft forever preferred_lft forever
inet6 fe80::fc20:aeff:fe53:bfab/64 scope link
valid_lft forever preferred_lft forever

</controller> <interface type='ethernet'> <mac address='fe:20:ae:53:bf:ab'/> <target dev='tap0' managed='no'/> <model type='virtio-non-transitional'/> <mtu size='1500'/> <alias name='ua-default'/> <rom enabled='no'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='unix'>

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants