Tension the belt normally. Start the vehicle and with it running take a tire crayon, regular crayon, candle, anything made of wax and hold against the V part of the belt, not the top. If the noise changes it is the belt.
How old is that belt? It may be as simple as the belt.