Yep, something intermittent/loose/dirty. You can either identify what it is and fix it or go through every connection you can find and check/clean/grease and put them back together.

http://www.4crawler.com/4x4/CheapTricks/RearWindow.shtml#MoreTroubleshootingTips