where are you?? .. nova scotia?

ken

U.K. Yorkshire

Certainly looks like azalea leaf gall, a fungal disorder. Is that plant an azalea? I'm not 100% certain about that.

Yes I think it is. Is there any way to get rid of the fungal disorder or am I best just cutting it off?

https://www.google.com/search?q=azalea+leaf+gall&ie=utf-8&oe=utf-8

Removal of all infected leaves is mandatory....those can't be 'cured' and will be a source of reinfection as long as they remain. The plucked leaves should be physically removed entirely from the garden, as well any leaves that may have fallen to the ground. Housekeeping chores play a very important role in the prevention of this particular disease.

Unless the infection is very bad on numerous plants, chemical control is not called for. Just groom the plants periodically, washing your own hands and clippers so not to spread the disease.