This seems like normal behavior. It's basically impossible to maintain stable hover that close to the ground.
When you hold an armed quad in position 2 motors will go nuts trying to raise one side, high side is trying to make as close to zero thrust as possible, when it's trying to correct for yaw it must spin whatever prop on the low side that will generate rotational force to counter external force rotating the craft. You think you're holding it still, but the flight controller is trying to correct for the slightest movement, airmode makes the quad over react to every bounce on the ground, the "hover" should be at like 30-60% throttle. If that's the case pop the throttle past 60% for half a second to get off the ground into clean air, then hover at like 1 meter; it should take many tiny corrections from you and it's very hard to hover perfectly still.