Cows milk is indeed acidic, but only just barely.
Most cow's milk you buy at the store is anywhere from 6.2 - 7.0 pH.
Today, for example, my milk started at pH6.9
7.0 is considered neutral.
Health is a whole 'nother story. From a fat/cholesterol perspective, you have a point.