Are you keeping the blue color?

No, we want something different

What strikes me is that there's too much bright white trim. What you see is less a house than a grid. I'd be tempted to go with a cream for the siding, one that goes with the colors in the brick. A paler cream for the trim wouldn't stand out as much.

You could also go with a brown siding and cream trim, with just far less trim colored cream. For example, I would not highlight the verticals.

I think you have an attractive house under that checkerboard.