I've had similar problems and have been using a stiff brush followed by a spray of vinegar. Seems to be working well for vacuum packing.
My problem has been a roundish yellow mold about the size of a dime, one I've seen in quite a few pictures here. Anyone know what this could be, or if it will affect the cheese?