you can look into lime wash or white wash options on your brick exterior. We need more pictures of the exterior to give you informed advice. A picture of the kitchen would also be helpful.

If you are going to replace the cabinetry in your kitchen consider white panted cabinets with integrated shaker style panel doors on the dishwasher and refrigerator. Then look for a vintage stove or a white semi professional style stove (or color of your choice). You can take a color cue from your vintage collection for your choice of back splash tile. Carera marble counter tops are an authentic vintage choice.

If you are determined to go retro why not consider vintage inspired new appliances - or just the fridge?

check out these different manufacturers that offer various style and color options, as long as you don't mind the price tag:

http://bigchill.com/shop/refrigerators/original-big-chill-retro-refrigerator/

http://www.smeg.com/smeg-refrigerators-and-freezers-exuding-style/

http://www.elmirastoveworks.com

as far as your other questions go there are so many personal choices to consider as well as the all important budget. Why not post a few pics of your kitchen space to inspire the houzz community to answer your query better?

If you plan to keep the cabinets, you could reface them with Shaker style doors which will look more 1920s, but not too retro. Get a counter depth refrigerator that accepts wood panels. Then it will disappear. You could do that with the dishwasher, too.

My first thought for the fridge was a Smeg but I see Rusty Empire beat me to it!