Exactly - if it works, why not? I started out using a basket from a deep fryer as my mold (the sides were slanted, so it was a pain), several layers of cut-outs from ice cream pail lids as followers, and my weights were a variety of coffee cans, etc. full of sand and water. Not very stable and the cheese wasn't very pretty, but it was cheese. I always start out as inexpensively as I can, to make sure that the hobby is something I really want to do, rather than spending all kinds of money to find that I hate it.
The biggest issue with small cheeses is that they can dry out awfully quickly, leaving you with a lot of rind and not much edible cheese. I vote for another goat!
(Please remember that I have a cow who is currently giving me three plus gallons of milk a day. I want everyone in the same boat I am!)