Most of the kitchen cabinet companies have a bathroom line and the kitchen height 33-36 inches as opposed to bathroom height 31-33 inches has become increasingly popular, so why not? It is afterall YOUR bathroom and in the end, I don't think anyone will know the difference.

In regards to your comment "Contractor was not happy", don't compromise your needs, budget or what you want just for your contractor's schedule. As Bill Vincent once reminded me, He works for YOU. He can change the schedule if that's what you need him to do and he may not be happy about that either, but it happens all the time, he'll survive. Bottom line is take the time to do what needs to be done to make you happy with the end result as you're the one who will be living with it, not him.