If the cause of the noise is a bearing, say in the idler pulley, you'll have to remove the pulley anyway to R7R the bearing or replace the pulley. I would look into a loose belt first, tighten a little if it feels sloppy. Is the noise really high pitched or kind of a grinding noise?