Don’t you have any recourse to the local planning department?

I've tried and they say it is within all setbacks.  Tried with the builder and all they've said is that it's been approved

It does not look like you have any ground to plant in unless it is outside the fence?

No room to plant.  Had I known I would have left some.

A built structure is your only option than. Don't think fence. Think decorative panels, pergola type open roof over the pool...........

Thanks Chris...I thought about somehow securing white lattice pieces with greenery on them to add height or even some sort of screen we can raise up.  I am hoping maybe the new neighbours will want privacy and add something to their deck which would help

A shade sail might be an option to consider too. Flimsy lattice panels are a bad choice.

Yes a shade sail could work.

I just built this pergola (there's kits too)... a bit more lattice, sail shade on top perhaps. Of course there's always adding disco lights for your new neighbors ;-)

Ugh, I wouldn't like that at all and right over your pool too.

Our neighbors behind us, which were already higher than us, built a huge two story home right up to the set back with a balcony that looks down onto our backyard. It robbed us of any privacy. We planted tall bamboo at the fence line. It has taken us awhile, but every year we get a little privacy back as the bamboo grow taller and thicker. They are now 40+ feet - taller then the roof of our neighbors home

I know you don't have much space, but what about bamboo in a long container? Something like this - http://bamboogarden.com/Cedar%20planters.htm

Thank you for bamboo idea. I wonder if I can purchase tall ones and if it will survive our Canadian winters....some research for me to do.

Horizontal containers planted with whatever will grow in your climate ( perhaps evergreens? … I’m not familiar with what grows in your climate ). I think pergolas, shadesails, etc , will only add visual clutter, but that’s just me, I prefer simplicity.

Thank you for horizontal planer suggestion.  I wonder if I can planters that will sit on top of my fence that will be sufficient for large enough plants?

I doubt that your fence top is wide enough for the size of planters you need. There are ways to elevate them via bricks, pavers, etc. if needed. How wide is the space between your pool & fence?

4 feet between pool and back fence I believe

I used Corten steel 4’ long by 18” wide planters at my last house for privacy between my front yard patio & busy street. You can find planters in a wide variety of finishes, fiberglass, cement composites, etc. I did add drip irrigation to my planters for the vertical , narrow growing “Emerald Holly” … not sure they would survive your winters, I live in a very different climate, beach, So California.

What is your hardiness zone? (or provide us a more exact geographical location). You will most likely have a very limited palette of plants you could use that will survive a winter outdoors in a container.

I think some sort of structure - shade sail, pergola, etc. - would be a much better and low maintenance choice.

Btw, I used stacked pavers to elevate my planter somewhat.

I'm in eastern Ontario...Ottawa area.  I will have to see what will survive.  :)

You might be able to pull your fence panels and put them on top of a new short plain fence. I can't tell what they're made of.

Might be worth consulting a local fence pro.

Thanks Fori! I have a call into the fence place we purchased from.  I really don't want to have to pull up and re-cement higher fence posts in...but I'll see what the fence company says.