When you pull a vaccuum line you are simply taking a load off of the engine, That is why it is idling up.

Um, no. Vaccuum lines do not place a "load" on the engine. Pulling a line adds fresh air to the mix and the engine will speed up or idle badly, depending on the amount of fuel available.

For the above, it sounds like you a) misadjusted the idle speed (like Ed said) or the passage is clogged. If you crack the throttle a little bit, does it idle?

Michael