I'd like to add that this feels like a regression, perhaps with the 5.x series of Debian kernels. With a 4.19 kernel, I never had this.