Hi Matt,
I am allergic to penicillin too. I've never seen such a warning. I make Camembert and Brie adding penicillum candidum with the starter culture (it doesn't have to make any difference). Untill now, it had no effect on me, both, home-made and store bought.