It looks like it may be Eupatorium maculatum.

Here is a link that might be useful: images - stems

This isn't it... says the Joe Pye Weed has whorls of leaves up until the bloom. What I have has only pairs of leaves. :(
Thank you though!!

A larger image would certainly help ID your plants. It's impossible to see any details in your picture. That said, they do look like young JPW as Carol suggested.

Here is a link that might be useful: {{gwi:174831}}

Wow - it looks EXACTLY like that link! But from the descriptions I've read they said JPW have whorled leaves up the stem, but my plant does not. But it really is just like a took a pick of my plant and put it in your link.
Thanks y'all! Now I know not to yank it up! :D