There's an option in your My Account where you can freeze your karma. It'll deduct 0.5 karma points from your present karma level.

Until you un-freeze, your karma won't move up or down.