№ 1048Reddit post
Muse Spark traces a kernel bug eating 2GB of RAM
Had Muse Spark trace boot logs across several Ubuntu kernels on Zorin OS; it found kexec handover (KHO) reserving ~2GB of RAM and breaking his llama.cpp loads, fixed by turning KHO off in GRUB.
Is KHO needed?
Solution: So after more research it seems that this KHO was recently activated in the latest Ubuntu kernel which zorin is based on. It seems to be for live updates of kernel and whatever but it puts quite a bit of strain on system that requires a lot of memory like AI work load. So I edited my GRuB file to turn it off. I was lucky that somehow my 7.0.0-30 kernel had a bug that disabled the KHO also thank you to Muse Spark AI for able to run all the trace and helped me figuring it out. KHO locked out 2gb of RAM causing my Llama cpp out of memory error.
The original post
So I been running Zorin OS as my semi daily driver for learning AI and fun. I been plague with odd behavior as I run my AI on knife edge consuming nearly all 16 GB of Ram and 8 GB of VRAM.
I found something odd, that my AI would failed to load depending on which kernel.
It turn out at least one of the culprit was KHO it somehow ate about 2GB of RAM. I found this because my Kernel 7.0.0-30 and the old 6.17 load my AI just fine but kernel 7.0.0-28 and the latest 7.0.0.-31 always failed to load.
Below is the AI analysis that I had it trace issue through my system:
-30boot-2: `Memory: 15384980K avail / 8261
