I've been looking at old kitchens a lot lately--they made do with few cabinets and huge sinks, mostly unfitted. I've also been looking at limebased, chalk and milk paints, and you can find a lot of doi-it-yourself recommendations online. Chalk paint can be used on old painted cabinets just like it is used on old furniture, and the great thing is that it requires not as much surface prep as latex or acrylic. The final surface is waxed, which sounds impractical, but it actually wears quite well and can be renewed easily, versus poly. It would have a nice matte finish (can polish to a higher gloss if you wish) so it would perhaps fit in better to an authentic old house.

You may qualify for tax credits for authorized repairs--mostly to exterior and structural, not for a new kitchen. However any interior changes would be reviewed to ensure that the integrety of the house is maintained (new kitchen, OK, all replacement windows or synthetic siding, not OK). Some states give as much as a 25% tax credit, so it is worth checking out, and can give referrals to specialists at maintaining old houses. For example, wood window specialists (check out John Leeke for some good DIY advice) and masonry repair. It is very important to match the old mortar, not just for aesthetics, but because old handmade bricks are quite soft and modern mortars will cause them to crumble.

Living in an old house is a long-term research project, but it sounds like you are up to the task. Kitchens and bathrooms are always a pickle in such homes. I can recommend the blog 1912 house for lots of information about historic kitchens and bathrooms to about 1890. IKEA has some unfitted kitchen lines, and is a great source for butcherblock and some great farmhouse and stainless steel sinks, and cabinets designed to accomodate small refridgerators. An old-fashioned salvage sink with integrated sideboards could be great under those big windows.

Older wood windows, even from the 1960s, are worth fixing rather than replacing for a whole lot less money than new.

You kitchen has a wonderful fireplace, floors, ceiling, and quite a lot of space and light. The window seat would be a wonderful place for a round table. the existing stove is great--lots of people love those old type of stoves and you can get it restored. If you don't want to do that, you can probably sell it to a restorer or enthusiast, esp. if it is gas. Nice big vent hood--if it doesn't work or is loud, can replace just the mechanism--high end ventillation fans are litke that anyway.

I actually like the orange color--old formica wears like iron, and that sort of color to red was very common in the 1940-60s. The square edge indicates it is 60s, about the time the kitchen was remolded. It would look so much better with a different color of cabinet--sort of a coral/salmon color, which is really "in" this year. The chartreuse is growing on me, but I would paint to a more neutral color so the focus is on the fireplace.

I have mixed feelings about the hardware--you have some of the real thing above the fireplace, and this is a poor imitation, but shiny chrome or stainless doesn't do it either. Perhaps heavier oil-rubbed bronze would be OK, maybe stainless if you get stainless appliances. It is a tough balancing act to mediate between the very old, the middle aged and the new. As an artist, perhaps you can find a happy balance, and work with the color and create something unique and wonderful.

Whatever you do, I would go more subdued and rustic than fancy Edwardian white and marble route. As you live in the house and get to know its quirks, it will speak to you, and staying true to its origin, but making way for modern conveniences, will help guide you. Perhaps there are others in the area who have gone down this path and they can help you, and refer you to sympathetic workmen.

Links on other recent discussions:

The Old House Guy--great info, excellent reference list http://www.oldhouseguy.com/services.php

Enon House is a wonderful blog about restoration of a historic house in just awful condition. Great for masonry and carpentry details It hasn't been updated since they added on a huge wing and moved there fulltime, which I think could have been done a bit differently to keep the old house front and center, but it was truely a labor of love. http://www.enonhall.com/

Windows:
https://www.houzz.com/discussions/stay-with-old-wood-anderson-windows-or-update-dsvw-vd~265169

Historic kitchens:
https://www.houzz.com/discussions/kitchen-design-issue-how-to-get-more-natural-light-and-whether-to-add-island-dsvw-vd~270683

Historic house links (near bottom--long post)
https://www.houzz.com/discussions/what-color-to-paint-house-what-style-is-it-dsvw-vd~265616
(Be sure to look at the National Park Service, Historic Preservation Technical Briefs link)

Chalk paint:
https://www.houzz.com/discussions/need-to-decide-how-much-taupe-and-cream-paint-to-change-dining-area-dsvw-vd~265490 (scroll down to bottom)
(Mustard seed link also has other historic paint recipes)

Unfortunately where I live, there aren't any early 1800 Federali/Greek Revival houses, but there has been a lot of documentation on them because people have recognized their historic importance for a long time. The modern historic preservation movement got its start with an upswing of interest in the 1920s with the 150th anniversary of the Declaration of Independence, and an effort to preserve Mount Vernon and Paul Revere's house.