It could be that Xen’s dynamically shifting your VM’s vcpus to a E-core. See this thread for optimization of 12/13th gen core processors.
Also, please provide some more information about 11th gen that your are referencing. For example, was it i9-11900K, or i5-1135G7? That does make a difference.