I don't know if you won't get any fruit, but it will be greatly reduced. Pollination by insects is essential to good fruit production. Blooming seems to come in "flushes", lots of blooms for a while and fewer blooms for a while. I suggest using a pot which can be eaily moved. Buy a set of hand trucks from Wal-Mart, Lowe's, Home Depot or Big Lots for about $30. It will allow you to easily move the plant. Every serious gardener must have a set of hand trucks. My 84 y/o mother bought a set. After it sets fruit, move it back to the lanai to enjoy. It will still bloom and smell good while the fruit matures. During winter, I open my greenhouse on warm days to allow insects to pollinate my citrus tres. During the summer I put them outdoors.

Citrus is self pollinating and will set fruit with or without human intervention. As far as how many fruit, this depends on how many fruit the tree can support. This is a complexed area that only mother nature has control of. While most of the blooms may become pollinated, the tree will selectively drop almost all of them on its own. There is no way to make the tree hold onto them. By the time the fruit is marble size you will only have about 2% left to grow to maturity.

My trees are kept inside for the winter. They both bloom and fruit without any intervention from me or insects.
Andi