View Issue Details

IDProjectCategoryView StatusLast Update
0000422AlmaLinux-8kernelpublic2023-10-17 00:42
Reportergvde2 Assigned Toalukoshko  
PrioritynormalSeveritycrashReproducibilityalways
Status resolvedResolutionfixed 
Summary0000422: AlmaLinux 8.8. kernel issue - missing patch
DescriptionThe kernel for 8.8 introduced an issue for VMs running on Xen that makes it impossible to pause or migrate VMs in the xen pool.

It’s explained here: https://xcp-ng.org/blog/2023/06/09/troubleshooting-live-migration-crashes-in-rhel-8-8-and-derivatives/

This patch is missing: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/drivers/xen/events/events_base.c?id=a0bb51f2638e0810c347024679239fd10a8f7990&ref=xcp-ng.org

I have noticed that for rhel8.8 the latest kernel 4.18.0-477.21.1.el8_8.x86_64 does include the patch, while it is still missing in the same version on almalinux 8.8.

On almalinux:

[root@alma8 ~]# uname -a
Linux alma8.dkrz.de 4.18.0-477.21.1.el8_8.x86_64 #1 SMP Thu Aug 10 13:51:50 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux
[root@alma8 ~]# grep xen.*vector /proc/kallsyms
ffffffff8e9e34f0 T xen_callback_vector
ffffffff8e9e3633 t xen_callback_vector.cold.25
ffffffff8f000fb0 T xen_hvm_callback_vector
ffffffff8f7fe810 r __ksymtab_xen_have_vector_callback
ffffffff8f8096af r __kstrtab_xen_have_vector_callback
ffffffff903b1030 D xen_have_vector_callback

on rhel8.8

[root@rhel8 ~]# uname -a
Linux rhel8.dkrz.de 4.18.0-477.21.1.el8_8.x86_64 #1 SMP Thu Jul 20 08:38:27 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux
[root@rhel8 ~]# grep xen.*vector /proc/kallsyms
ffffffff9b7e4740 T xen_setup_callback_vector
ffffffff9b7e487e t xen_setup_callback_vector.cold.25
ffffffff9be00fb0 T xen_hvm_callback_vector
ffffffff9c5fe840 r __ksymtab_xen_have_vector_callback
ffffffff9c6096eb r __kstrtab_xen_have_vector_callback
ffffffff9d1b10f0 D xen_have_vector_callback
Steps To ReproduceRun a AlmaLinux 8.8 VM on Xen or Citrix Hypervisor with kernel 4.18.0-477.21.1.el8_8.x86_64 installed and migrate or pause the VM. It will reset and boot.
Tagsalmalinux8
abrt_hash
URL

Activities

toracat

2023-08-27 16:54

reporter   ~0000962

I can confirm this patch is not in Alma-8's kernel.

alukoshko

2023-08-28 11:53

administrator   ~0000964

Unfortunately after Red Hat decision to not share sources we don't have legal way to get updated tarballs of RHEL kernels so we do Oracle Linux way now by providing only security fixes.
But this patch doesn't look so complicated and I think we can release it to Testing repo pretty soon.
Will you help with testing, gvde2?

gvde2

2023-08-28 14:32

reporter   ~0000966

Yes. I can test the kernel in a few of our test AL8 VMs.

alukoshko

2023-08-28 15:46

administrator   ~0000967

gvde2, before I release to Testing could you please check package directly from build system?

curl https://build.almalinux.org/pulp/content/builds/AlmaLinux-8-x86_64-7247-br/config.repo -o /etc/yum.repos.d/albz422.repo
dnf update

gvde2

2023-08-28 18:42

reporter   ~0000968

I have created a test vm, installed the 21.2 kernel, rebooted and was able to migrate the VMs between hosts in the xen pool. So it seems to fix this issue.

alukoshko

2023-08-29 06:55

administrator   ~0000969

Thanks for update. Releasing to Testing repo.

toracat

2023-08-30 18:42

reporter   ~0000971

@alukoshko

Is it going to stay in the testing repo or get moved to the main repo eventually? Sorry I don't know how a case like this is handled.

alukoshko

2023-08-30 19:52

administrator   ~0000972

@toracat
This patch will be definitely included in next kernel update.
For this particular build I don't know yet because new kernel version higher than RHEL's one can surprise users.

alukoshko

2023-09-28 12:12

administrator   ~0000982

Fixed in latest AlmaLinux 8 kernel update

Issue History

Date Modified Username Field Change
2023-08-27 09:38 gvde2 New Issue
2023-08-27 09:38 gvde2 Tag Attached: almalinux8
2023-08-27 16:54 toracat Note Added: 0000962
2023-08-28 11:53 alukoshko Note Added: 0000964
2023-08-28 14:32 gvde2 Note Added: 0000966
2023-08-28 15:46 alukoshko Note Added: 0000967
2023-08-28 15:46 alukoshko Assigned To => alukoshko
2023-08-28 15:46 alukoshko Status new => feedback
2023-08-28 18:42 gvde2 Note Added: 0000968
2023-08-28 18:42 gvde2 Status feedback => assigned
2023-08-29 06:55 alukoshko Note Added: 0000969
2023-08-29 13:46 alukoshko Status assigned => feedback
2023-08-30 18:42 toracat Note Added: 0000971
2023-08-30 19:52 alukoshko Note Added: 0000972
2023-09-28 12:12 alukoshko Note Added: 0000982
2023-09-28 12:13 alukoshko Status feedback => resolved
2023-09-28 12:13 alukoshko Resolution open => fixed