If you want to be slick...install the fence about 6" inside your property line. That way he has no rights to your side.

Painting funky stuff on his side will only cause problems with the architecturally controlled neighborhood(HOA). Just install it all on your side of the property line and face all the boards on your side. He'll have the ugly side on his side and since it's on your property there's not much he can do..