That makes no sense. The holes are either on top or on bottom BEFORE you tension the pulley. Do you tension it clockwise or counter-clockwise. It doesn't "do it by itself". If you look at the pictures, in one it shows you push DOWN to tension, in the other it shows you tension UP.

Sounds like you don't know either.