I think of vegitative buds as being like an investment. You may not get fruit now but it will sure give you a heck of a lot more later. Most citrus, if healthy and grafted (not grown from seed), don't really have the problem of not producing "enough" flowers. The fruit will set if the tree has enough resources for it to grow properly. You want this to occur, as it takes a lot of energy to produce fruit and can hinder the growth of the plant. Usually, the problem with citrus is actually that the tree will set fruit when it shouldn't and as a result will stagnate or slow new growth. It looks like from your pictures that some of your buds are already producing flowers which in turn will produce fruit. Given the small size of your trees, I would thin to one or two fruit.