I'd suspect something w/ the vacuum line going into the booster, like it's freezing up or something. If it were the master cylinder leaking, I think the pedal would go to the floor. You could also perform the brake booster test to make sure your booster is airtight.