If it were mine, I'd put the stake back in BUT don't tie it all the way up straight.

And use an old nylon stocking or stretchy material so the tree can bend and sway with the wind, yet get pulled back up to where you want it when the wind subsides.

3 months probably isn't long enough for the tree to harden up.

Thanks, Bill. I decided to put the stakes back in and used old pantyhose (my favorite gardening tool :) to secure it. Fortunately it's cooling down and I can reduce watering, so I hope the rampant growth will slow down, and the tree can work on the trunk and the roots rather than the canopy.

You want the tree to move when the wind blows, the stocking helps protect the tree from breakage yet gives it some movement. Without plenty of movement, the tree won't adjust like it will with movement.

I've noticed it can take a whole season for a tree to be 'on it's own' so to speak.

Thanks for responding and try to come back and let us know how it all turns out. 8^)