How much sun is the passie getting and have you been fertilizing? They usually bloom on new growth but if they are overfed, sometimes they grow alot of vine and are often reluctant to bloom until much later in the season - sometimes too late for northern gardeners including during a time when frosts are happening or if a tender specimen comes inside to somewhere with less than ideal light.

What kind of jasmine? You can bring it in but make sure that it gets plenty of humidity around it as they known to drop leaves when brought in and/or if the air around them is too dry.

It sounds like passiflora incarnata or "maypop." P. incarnata is the hardiest of the passion vines but I must say, I'm somewhat surprised that it survived the winter in your zone 5 garden.

I'd just like to warn you that this plant will take over everything in it's path. And if that wasn't bad nuff...it will form new plants that will pop up several feet from the mother plant. I had one growing on a large tree stump in the middle of my perennial bed for 2 years. I reluctantly yanked it out but it kept re-sprouting throughout the bed. I think I finally got rid of it. The only way I would plant it again is if I had a trellis surrounded by lawn so I could mow around it. Someday.

Sorry to be a bummer!

Here is a link that might be useful: Passiflora incarnata