Have seen this with flowers coming off of the branches and upper most part of the caudex. Many times with no leaves on them.

Not necessary to remove. With it being as early as it is in the year. If you where to prune this tree. you could very easily get another flush of blooms. More blooms if it produce many lateral branches from each cut branch.

Rick

Yep, no leaves here. Just flowers growing right out of the side of the branch.

Rob