Not necessarily pruning, but if you don't want to lose the blooms but you want to do some shaping earlier, you could wire the tall branches downwards. It breaks the apical dominance and encourages a more bushy shape.

i actually just discovered wiring, that should make it look better

I use wire on most of my trees to shape them. The key with citrus is to wire them and bend them while they're still soft. It's helped me keep fruiting wood while still keeping the size down.

If that little tree carry a lot of fruits, I feel sorry for those little branches. Seeing a lot of fruits on a bigger tree looks great but on a little not so much. It’s always important to shape a tree than worry about fruits. On this forum things are different, their moto: let it rip! Don’t do nothing.

Do you know by chance what type of Valencia orange you have? mine was just labelled Valencia..

Yes I agree with pulling that right side branch up by wire instead of pruning. You don't want fruit like mine which is near the very base of the plant . When you leave fruit on a young tree it will always pull the branch down from wherever it originally sat.

I'll follow your advice, thanks everyone. As soon as the blooms is over, I'll get some wires and shape the branches upwards, it should look better. as for the large side-shoot that I have staked up with the stick, I'll let it do its thing. Maybe by next fall all the tree will be a mix of a upright and bush.