You might try some bleeding hearts in a shady area of your garden. They bloom early and the hummers that visit my yard in the spring come to it. It's interesting to watch them feed from it too. They kind of spin in a circle, I assume, getting nectar from all inside parts of the flower. It's a pretty plant and bloom in it own right, but the hummer visits enhance its attractiveness.

Wild Jewelweed (Impatiens capensis) doesn't bloom until late summer early fall. It is used to help supply nectar to migrant hummers when other summer plants are winding down. My Salvia coccineas, Salvia Guaraniticas, bloom all summer right up until the time they are killed by a freeze. Pineapple sage and Salvia Microphylla 'Wild Watermelon' bloom as the days are getting shorter in fall. Coral honeysuckle will bloom all summer and into fall. Agastaches will bloom all summer and fall. Gartenmeister fushia will bloom all season but it is tender and will have to be brought inside once the temps start dropping. My bat faced cuphea bloomed until I brought it inside for the winter in November then i cut it back and it has doubled in size already and I am looking forward to putting it back out for the hummers next spring. My cannas still had blooms up until our first hard freeze. Impomopsis (standing cypress) is another hardy plant that will bloom through fall. Even after a couple of freezes mine is still green. Lobeliea cardinalis (cardinal flower) and Lobelia Siphilitica (Great Blue Lobelia) bloom later in summer through fall until frost. The Great Blue Lobelia does seem to be a bit hardier than my Lobelia Cardinalis and can take withstand more freezing. There are also late blooming hostas that my hummers feed on that will bloom unitl early to mid fall.
Cypress vine (cardinal climber is a hybrid of the cypress vine) will bloom earlier and longer than cardinal climber.

Spring flowering plants besides the bleeding hearts already mentioned by Wetbug that may help are:
baskets of red impatiens (I make up several baskets to hang around my yard as soon as they are available)

azaleas
rhododendrons
dwarf red buckeye (flowering tree which can be pruned to height)
bottlebrush buckeye (flowering shrub)
Weigelia (mid spring blooming shrub)
Red flowering currant (shrub)
Flowering Quince (shrub)
Leonitus leonurus (Lion's Tail)(Spring through fall)
Native columbine which you have
Cross vine (related to trumpet vine but a spring bloomer)
Coral bells
White wild Indigo
Lily of the valley

Penny

I had a hummer at my lobelia cardinalis too! That is reason I bought it. I saved a bunch of seed. Did you save any? How long have you had yours? Do you get seedlings? I grew it in a whiskey barrel on the deck. It grew several stems, the tallest about 6 ft! I left some seed in the barrel but saved a bunch. I'm going to winter sow some. Any info from you would be great since we don't live too far from eachother. Thanks!

October,
I didn't save any of the seed from my lobelia cardinalis this year. I divided and transplanted it late this year so the flowering was later than usual and the seed pods didnn't fully ripen so i just left them on the plant. Last year I did collect seed and wintersowed it and they did great but I never got around to planting them out and gave them to a friend. I hope my transplant had time to get established this year and comes back next year so that I don't have to replance it with another store bought plant.

Last year I just sowed the seed on the surface of damp soil and then used a mister spray bottle to settle the seeds into the soil since they are so fine. I covered my wintersown containers with clear plastic and just sat back and waited for them to germinate in the spring. So far I haven't had any reseed but the area mine was in gets a lot of water when it rains so the seeds could be floating away. That was one reason for transplanting it so I could grow it in an area without heavy deluges of water.

Penny

My Cardinal Climbers are just beginning to make significant bloom. A little late, I think. I planted out seedlings in late May or early June.