I would not paint the brick. With the exception of some color from the brick, to cover those bright yellow brick, that are shown in your picture. I would paint all the siding a creamy color, or some other color that is in your existing brick. Your shutters appear to have been on there for a long time, so once you remove them to paint, there will most likely be spots on the brick, that would make it noticable, if you didnt put them back up. If that isnt the case, then I wouldnt put them back, since you only have them on three windows anyway. You could definitely use some new landscaping.