1) Gates 91006 Serpentine Belt Alignment Tool
2) Autozone 27031 Power Steering Pulley Puller/Installer (loan a tool)
3) Check alignment of power steering pump pulley and adjust if necessary.
4) Check if the tensioner is bent torsionally.
Tensioners can fail in many ways.
They can bend torsionally, snap the arm, rip the bushing straight out of the center.
I've seen it all.
When we first started out we would purchase new tensioners to get the springs out of them.
Our customers would also send in their broken tensioners so we could recover the springs.
Since then we have gone to brand new springs made to OEM specifications.
Randy (Born To Run) was one of the first to purchase one of our tensioners.
He sent it back a year later to get it re-clocked.
Some people depending on pulley combinations and belt lengths may be running their tensioner lower than others requiring a little more spring tension.
Alternately if running the tensioner a little higher the set screw can be removed to avoid hitting the stop.
The only purpose of the set screw is for ease of installation of the tensioner.