What recipe are you following?
I'm certainly no authority, but I've read several recipes and the 4 days you mention is the shortest amount of time I've seen. 200 easy cheeses says 2 weeks, but that instruction is ambiguous about 2 weeks from what point in the process. Others I've read say to pierce at 3 to 5 weeks. Sailor, who successfully makes lots of them, says he pierces his when the blue on the outside of the cheese is really taking over.