Wise began his career at Wimbledon, where he was part of the 'crazy gang'. In 1990, he moved to Chelsea, the club he would represent most in his career, and where he would eventually become captain. During his time in South London, he won 2 FA Cups, a League Cup and a Cup Winners Cup, then making him Chelsea's most successful captain ever.

He scored on debut for England, against Turkey, and went on to win 21 caps for his country,