On my 94 4runner (4X4), I can move the outer CV joint by holding on to the CV Boot. I can move the CV joint about 1/8 of an inch in any direction expect in and out. When I am driving on anyhting but flat, smooth pavement, i can hear the Cv Joint rattle. Is the CV Joint bad? Could it be caused by loose or damaged bearings?

Thanks,
Christopher