Just to clarify, there are 4 settings:
1. On
2. Press button once: stability control still on, traction control off
3. Foot on brake, double click button: Sport mode
4. Foot on brake, hold button for 7 seconds: everything off
From your description it sounds to me like you are not in Sport...